Nov 04 05:48:29.685003 ip-10-0-133-0 systemd[1]: Starting Kubernetes Kubelet... Nov 04 05:48:30.102403 ip-10-0-133-0 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:30.102403 ip-10-0-133-0 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 05:48:30.102403 ip-10-0-133-0 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:30.102403 ip-10-0-133-0 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:30.106669 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106582 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.106669 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106665 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.106669 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106669 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.106669 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106672 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.106669 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106675 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106679 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106682 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106684 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106687 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106689 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106693 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106696 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106698 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106701 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106703 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106706 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106709 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106711 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106714 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106716 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106719 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106721 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106736 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106739 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.106874 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106742 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106744 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106747 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106749 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106752 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106755 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106757 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106767 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106770 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106773 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106775 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106778 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106781 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106783 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106787 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106790 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106793 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106795 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106798 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106800 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.107340 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106803 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106805 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106808 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106811 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106813 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106816 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106818 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106821 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106823 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106825 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106828 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106830 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106833 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106835 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106838 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106841 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106843 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106846 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106850 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.107868 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106853 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106855 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106858 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106861 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106864 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106866 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106869 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106872 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106875 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106879 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106884 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106888 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106891 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106894 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106897 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106900 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106902 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106905 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.108320 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106909 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106913 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106917 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106920 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106923 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106925 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106928 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106930 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106934 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106937 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106939 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106941 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106944 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106947 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106950 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106952 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106955 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106957 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106960 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106962 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.108865 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106965 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.109334 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106968 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.109334 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106970 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.109334 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106973 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.109334 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.106976 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.110082 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110069 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.110082 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110081 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110085 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110088 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110091 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110094 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110097 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110099 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110102 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110105 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110108 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110111 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110113 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110116 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110118 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110121 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110123 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110126 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110130 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110134 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110137 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.110140 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110140 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110142 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110146 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110149 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110152 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110155 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110157 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110160 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110163 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110165 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110168 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110170 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110173 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110175 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110178 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110180 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110183 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110185 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110187 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.110632 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110190 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110192 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110195 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110198 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110202 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110204 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110207 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110209 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110212 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110214 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110217 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110220 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110224 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110227 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110230 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110234 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110237 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110239 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110242 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.111109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110244 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110247 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110250 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110252 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110254 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110257 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110259 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110262 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110265 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110267 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110269 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110272 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110274 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110277 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110279 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110282 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110284 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110287 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110290 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110292 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.111561 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110295 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110297 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110300 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110303 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110305 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110307 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110310 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110312 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110316 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110319 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110322 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110324 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110327 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110330 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110332 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110334 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110337 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110339 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110342 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110345 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.112050 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110348 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110350 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110352 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110355 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110357 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110360 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.110362 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111628 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111637 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111642 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111645 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111648 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111651 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111654 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111657 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111660 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111662 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111665 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111667 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.112554 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111670 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111673 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111676 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111679 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111681 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111684 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111687 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111689 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111692 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111695 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111697 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111700 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111702 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111704 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111707 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111709 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111712 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111715 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111717 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111720 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.113020 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111722 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111736 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111739 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111748 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111750 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111753 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111766 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111770 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111773 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111776 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111778 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111781 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111783 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111786 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111789 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111792 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111795 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111798 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111801 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111803 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.113507 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111806 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111808 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111811 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111813 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111816 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111818 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111821 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111824 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111826 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111828 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111831 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111833 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111836 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111838 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111841 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111843 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111846 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111850 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111854 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.114060 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111857 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111859 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111862 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111865 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111867 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111871 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111874 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111877 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111879 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111882 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111884 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111887 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111889 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111892 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111895 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111897 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111900 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111903 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111905 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.114520 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111908 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111910 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111913 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111915 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111918 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111920 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111923 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111925 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111927 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111930 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111932 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111936 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111939 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111941 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111943 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.111947 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112832 2577 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112851 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112858 2577 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112863 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 05:48:30.115017 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112867 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112870 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112874 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112878 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112881 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112884 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112888 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112891 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112894 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112897 2577 flags.go:64] FLAG: --cgroup-root="" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112900 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112903 2577 flags.go:64] FLAG: --client-ca-file="" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112905 2577 flags.go:64] FLAG: --cloud-provider="external" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112908 2577 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112912 2577 flags.go:64] FLAG: --cluster-domain="" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112914 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112917 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112920 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112924 2577 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112927 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112930 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112933 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112936 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112939 2577 flags.go:64] FLAG: --contention-profiling="false" Nov 04 05:48:30.115482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112943 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112946 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112949 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112952 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112957 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112976 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112980 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112983 2577 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112987 2577 flags.go:64] FLAG: --enable-server="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112990 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112994 2577 flags.go:64] FLAG: --event-burst="100" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.112997 2577 flags.go:64] FLAG: --event-qps="50" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113000 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113003 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113006 2577 flags.go:64] FLAG: --eviction-hard="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113010 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113013 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113016 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113019 2577 flags.go:64] FLAG: --eviction-soft="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113022 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113025 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113028 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113031 2577 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113034 2577 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113037 2577 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 05:48:30.116064 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113040 2577 flags.go:64] FLAG: --feature-gates="" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113044 2577 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113047 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113050 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113053 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113057 2577 flags.go:64] FLAG: --healthz-port="10248" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113060 2577 flags.go:64] FLAG: --help="false" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113063 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113067 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113070 2577 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113072 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113076 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113079 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113082 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113085 2577 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113088 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113091 2577 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113094 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113097 2577 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113100 2577 flags.go:64] FLAG: --kube-reserved="" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113103 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113105 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113108 2577 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 05:48:30.116694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113111 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113114 2577 flags.go:64] FLAG: --lock-file="" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113117 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113120 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113123 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113128 2577 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113131 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113134 2577 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113137 2577 flags.go:64] FLAG: --logging-format="text" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113140 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113143 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113146 2577 flags.go:64] FLAG: --manifest-url="" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113149 2577 flags.go:64] FLAG: --manifest-url-header="" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113154 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113157 2577 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113160 2577 flags.go:64] FLAG: --max-pods="110" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113163 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113166 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113172 2577 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113176 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113179 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113182 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113185 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113192 2577 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113195 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 05:48:30.117262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113198 2577 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113201 2577 flags.go:64] FLAG: --pod-cidr="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113204 2577 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113207 2577 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113210 2577 flags.go:64] FLAG: --pods-per-core="0" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113213 2577 flags.go:64] FLAG: --port="10250" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113216 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113218 2577 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-03403b7496f60a583" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113221 2577 flags.go:64] FLAG: --qos-reserved="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113224 2577 flags.go:64] FLAG: --read-only-port="10255" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113227 2577 flags.go:64] FLAG: --register-node="true" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113230 2577 flags.go:64] FLAG: --register-with-taints="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113234 2577 flags.go:64] FLAG: --registry-burst="10" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113236 2577 flags.go:64] FLAG: --registry-qps="5" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113242 2577 flags.go:64] FLAG: --reserved-cpus="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113245 2577 flags.go:64] FLAG: --reserved-memory="" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113248 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113251 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113254 2577 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113257 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113260 2577 flags.go:64] FLAG: --runonce="false" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113263 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113266 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113269 2577 flags.go:64] FLAG: --seccomp-default="false" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113272 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113275 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 05:48:30.117920 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113283 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113287 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113290 2577 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113293 2577 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113296 2577 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113299 2577 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113302 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113305 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113308 2577 flags.go:64] FLAG: --system-cgroups="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113311 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113317 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113319 2577 flags.go:64] FLAG: --tls-cert-file="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113322 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113326 2577 flags.go:64] FLAG: --tls-min-version="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113329 2577 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113331 2577 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113334 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113337 2577 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113340 2577 flags.go:64] FLAG: --v="2" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113344 2577 flags.go:64] FLAG: --version="false" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113350 2577 flags.go:64] FLAG: --vmodule="" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113354 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113357 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113513 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.118574 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113518 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113521 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113524 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113527 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113530 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113532 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113535 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113538 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113540 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113543 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113546 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113549 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113551 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113554 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113556 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113559 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113562 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113564 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113567 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113569 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.119164 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113571 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113574 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113577 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113579 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113582 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113586 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113590 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113593 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113597 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113600 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113603 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113605 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113608 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113612 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113615 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113618 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113620 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113623 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113625 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113628 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.120368 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113630 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113633 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113636 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113639 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113641 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113644 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113646 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113648 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113651 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113654 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113656 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113659 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113661 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113665 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113667 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113670 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113672 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113675 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113678 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113681 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.120866 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113684 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113687 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113689 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113692 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113695 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113699 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113701 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113704 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113706 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113709 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113712 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113714 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113717 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113719 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113722 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113737 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113740 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113743 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113746 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113748 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.121337 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113751 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113755 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113759 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113763 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113767 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113771 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113775 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113778 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113782 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113785 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113789 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113792 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113799 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113804 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113809 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113813 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113816 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113821 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113825 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.121843 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113829 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113832 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113835 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113839 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113843 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113846 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.113888 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113937 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113943 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113948 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113952 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113956 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113960 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113964 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113968 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113972 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.122307 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113976 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113980 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113984 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113991 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113995 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.113999 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114003 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114007 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114012 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114016 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114024 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114029 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114033 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114037 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114042 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114046 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114050 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114054 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114058 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114062 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.122687 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114067 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114071 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114075 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114079 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114084 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114088 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114093 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114097 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114102 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114106 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114110 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114114 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114119 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114122 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114126 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114130 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114134 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114139 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114143 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114147 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.123179 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114150 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114154 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114160 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114164 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114171 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114196 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114202 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114207 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114210 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114214 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114218 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114221 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114225 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114229 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114232 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114236 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114239 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114243 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.123655 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114247 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114251 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114255 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114258 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114262 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114266 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114270 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114274 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114278 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114283 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114286 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114290 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114294 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114298 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114302 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114306 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114312 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114316 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114320 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114324 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.124105 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114329 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114334 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114339 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114343 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114347 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114355 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114361 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114364 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114369 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114373 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114378 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114382 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114386 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114389 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114394 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114404 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114408 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114411 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.114415 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.121634 2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 05:48:30.124622 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.121651 2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.121666 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.121671 2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121742 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121749 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121752 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121755 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121758 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121761 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121766 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121769 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121771 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121774 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121777 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121779 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121782 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121785 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121788 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121791 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.125111 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121794 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121796 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121799 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121802 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121804 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121807 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121810 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121812 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121815 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121817 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121820 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121822 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121825 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121835 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121838 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121841 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121844 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121846 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121849 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121852 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.125618 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121855 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121857 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121860 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121862 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121865 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121867 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121870 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121872 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121875 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121877 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121880 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121882 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121885 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121887 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121890 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121892 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121895 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121897 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121900 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121902 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.126109 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121905 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121907 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121910 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121912 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121915 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121918 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121926 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121929 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121931 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121934 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121936 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121939 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121941 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121944 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121946 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121949 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121951 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121954 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121956 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.126583 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121959 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121961 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121963 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121966 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121968 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121971 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121973 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121976 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121978 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121980 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121983 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121986 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121988 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121992 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121995 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.121998 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122001 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122004 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122006 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.127081 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122009 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122017 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122020 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122023 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122025 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122028 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122030 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122033 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122035 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122038 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122040 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122043 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.122070 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122239 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122243 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.127534 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122246 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122249 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122252 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122255 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122257 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122260 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122262 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122265 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122268 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122270 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122274 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122278 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122280 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122283 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122286 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122288 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122291 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122294 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122296 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.127979 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122304 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122307 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122310 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122313 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122316 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122318 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122321 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122323 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122326 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122328 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122331 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122333 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122336 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122338 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122340 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122343 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122345 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122348 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122350 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122353 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.128440 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122355 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122358 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122361 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122364 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122366 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122369 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122371 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122374 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122378 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122382 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122385 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122388 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122390 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122400 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122403 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122405 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122408 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122410 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122413 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122415 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.128934 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122418 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122421 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122423 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122426 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122428 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122430 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122433 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122435 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122438 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122440 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122443 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122445 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122448 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122451 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122453 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122461 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122464 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122467 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122469 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122472 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.129391 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122474 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122477 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122480 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122482 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122485 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122487 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122495 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122498 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122500 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122503 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122505 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122508 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122510 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122513 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122515 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122518 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122520 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122522 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122525 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.130063 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122527 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122530 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122532 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122535 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122537 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122540 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.122562 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122598 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122602 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122605 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122608 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122610 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122613 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122615 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122618 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122620 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:30.130851 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122623 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122625 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122628 2577 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122630 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122639 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122641 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122644 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122646 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122649 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122651 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122654 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122656 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122659 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122661 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122663 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122666 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122671 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122673 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122676 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122679 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:30.131449 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122682 2577 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122684 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122687 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122690 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122692 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122695 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122698 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122700 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122703 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122705 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122708 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122710 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122713 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122715 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122718 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122720 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122739 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122750 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122753 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:30.132083 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122756 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122759 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122761 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122764 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122767 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122769 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122772 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122774 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122777 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122781 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122784 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122786 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122789 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122792 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122794 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122797 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122800 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122802 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122805 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:30.132555 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122807 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122810 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122812 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122814 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122817 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122819 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122822 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122824 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122827 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122829 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122832 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122834 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122842 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122845 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122848 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122852 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122855 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122858 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122860 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122863 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:30.133279 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122865 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122868 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122872 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122874 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122877 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122879 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122883 2577 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122885 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122888 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122890 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122893 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122895 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122898 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122900 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122903 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122906 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122908 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122910 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:30.122913 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.122972 2577 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 05:48:30.133772 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.125216 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 05:48:30.134621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.126158 2577 server.go:1014] "Starting client certificate rotation" Nov 04 05:48:30.134621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.126257 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:48:30.134621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.126292 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:48:30.134621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.128429 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:48:30.134621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.132086 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:48:30.142939 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.142925 2577 log.go:25] "Validated CRI v1 runtime API" Nov 04 05:48:30.146329 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.146310 2577 log.go:25] "Validated CRI v1 image API" Nov 04 05:48:30.147163 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.147132 2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 05:48:30.150899 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.150880 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a3c6f9e5-607c-4146-8666-4bf4a3771c4b:/dev/nvme0n1p3 a5edb6b9-2509-40d2-bf34-0c0e8e17e43b:/dev/nvme0n1p4] Nov 04 05:48:30.150965 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.150901 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 05:48:30.155157 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.155050 2577 manager.go:217] Machine: {Timestamp:2026-11-04 05:48:30.154563862 +0000 UTC m=+0.350167051 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106980 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2908a5aa4e99a0c670f289c341fd16 SystemUUID:ec2908a5-aa4e-99a0-c670-f289c341fd16 BootID:f0d84363-bf6f-4760-a50c-60f6d17d51cd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:a4:02:04:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:a4:02:04:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:7b:24:04:53:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 05:48:30.155157 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.155150 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 05:48:30.155274 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.155219 2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 05:48:30.159022 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.158992 2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 05:48:30.159154 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.159025 2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-0.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 05:48:30.159195 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.159156 2577 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 05:48:30.159195 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.159164 2577 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 05:48:30.159195 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.159187 2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:48:30.159276 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.159202 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:48:30.160423 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.160413 2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 05:48:30.164637 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.164625 2577 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 05:48:30.164777 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.164767 2577 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 05:48:30.165632 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.165622 2577 kubelet.go:493] "Attempting to sync node with API server" Nov 04 05:48:30.165663 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.165639 2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 05:48:30.165663 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.165650 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 05:48:30.165663 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.165659 2577 kubelet.go:405] "Adding apiserver pod source" Nov 04 05:48:30.165765 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.165671 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 05:48:30.166047 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.166030 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:48:30.168233 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.168215 2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 05:48:30.175857 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.175839 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:48:30.176770 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176758 2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 05:48:30.176853 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176789 2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 05:48:30.176939 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176929 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 05:48:30.176971 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176945 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 05:48:30.176971 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176952 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 05:48:30.176971 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176958 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 05:48:30.176971 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176963 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 05:48:30.176971 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.176969 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 05:48:30.177763 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177755 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 05:48:30.177796 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177764 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 05:48:30.177796 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177772 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 05:48:30.177796 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177778 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 05:48:30.177796 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177786 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 05:48:30.177796 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.177794 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 05:48:30.179533 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.179525 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 05:48:30.179565 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.179534 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 05:48:30.183364 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.183352 2577 server.go:1263] "Started kubelet" Nov 04 05:48:30.183453 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.183430 2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 05:48:30.183503 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.183445 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 05:48:30.183548 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.183517 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 05:48:30.184075 ip-10-0-133-0 systemd[1]: Started Kubernetes Kubelet. Nov 04 05:48:30.186892 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.184916 2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 05:48:30.186892 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.185470 2577 server.go:317] "Adding debug handlers to kubelet server" Nov 04 05:48:30.190392 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.190374 2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 05:48:30.193452 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.193432 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 05:48:30.194044 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194028 2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 05:48:30.194135 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.194118 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:48:30.194803 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194779 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 05:48:30.194803 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194781 2577 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 05:48:30.194943 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194811 2577 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 05:48:30.194943 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194923 2577 reconstruct.go:97] "Volume reconstruction finished" Nov 04 05:48:30.194943 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.194934 2577 reconciler.go:29] "Reconciler: start to sync state" Nov 04 05:48:30.195797 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.195783 2577 factory.go:55] Registering systemd factory Nov 04 05:48:30.195797 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.195797 2577 factory.go:223] Registration of the systemd container factory successfully Nov 04 05:48:30.196016 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.196000 2577 factory.go:153] Registering CRI-O factory Nov 04 05:48:30.196016 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.196014 2577 factory.go:223] Registration of the crio container factory successfully Nov 04 05:48:30.196138 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.196074 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 05:48:30.196138 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.196093 2577 factory.go:103] Registering Raw factory Nov 04 05:48:30.196138 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.196119 2577 manager.go:1199] Started watching for new ooms in manager Nov 04 05:48:30.197208 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.197195 2577 manager.go:319] Starting recovery of all containers Nov 04 05:48:30.208496 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.208472 2577 manager.go:324] Recovery completed Nov 04 05:48:30.213670 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.213653 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.215307 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215288 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.215380 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215328 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.215380 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215347 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.215930 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215918 2577 cpu_manager.go:226] "Starting" policy="none" Nov 04 05:48:30.215969 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215932 2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 05:48:30.215969 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215949 2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 05:48:30.216027 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.215921 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.216641 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.216627 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.216687 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.216653 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.216687 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.216663 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.294708 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.335873 2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-0.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.335917 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-0.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.335870 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-0.us-west-1.compute.internal.18e4c180b7c399f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:30.183324147 +0000 UTC m=+0.378927334,LastTimestamp:2026-11-04 05:48:30.183324147 +0000 UTC m=+0.378927334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.us-west-1.compute.internal,}" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.357828 2577 policy_none.go:50] "Start" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.357841 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 05:48:30.358593 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.357855 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 05:48:30.359973 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.359668 2577 policy_none.go:44] "Start" Nov 04 05:48:30.394830 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.394810 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:48:30.395309 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.395283 2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 05:48:30.397721 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.397702 2577 manager.go:341] "Starting Device Plugin manager" Nov 04 05:48:30.397834 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.397746 2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 05:48:30.397834 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.397757 2577 server.go:87] "Starting device plugin registration server" Nov 04 05:48:30.397959 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.397948 2577 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 05:48:30.398016 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.397960 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 05:48:30.398102 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.398058 2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 05:48:30.398165 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.398153 2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 05:48:30.398165 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.398166 2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 05:48:30.398598 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.398579 2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 05:48:30.398695 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.398620 2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:48:30.405178 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.405146 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 05:48:30.406339 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.406319 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 05:48:30.406408 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.406341 2577 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 05:48:30.406408 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.406361 2577 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 05:48:30.406408 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.406394 2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 05:48:30.431967 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.431944 2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 05:48:30.432061 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.432000 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v6rgc" Nov 04 05:48:30.498172 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.498145 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.499071 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.499053 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.499155 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.499086 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.499155 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.499104 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.499155 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.499133 2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.507230 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.507211 2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal"] Nov 04 05:48:30.507280 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.507267 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.508036 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.508018 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.508092 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.508058 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.508092 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.508072 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.510407 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.510395 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.510551 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.510536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.510586 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.510566 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.511090 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511074 2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:30.511220 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511203 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.511280 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511240 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.511280 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511252 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.511374 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511212 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.511374 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511302 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.511374 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.511316 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.512207 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.512193 2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:30.513481 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.513468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.513545 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.513491 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:30.514164 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.514149 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:30.514242 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.514176 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:30.514242 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.514190 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:30.541653 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.541486 2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.544005 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:30.543986 2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.598143 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.598108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.598143 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.598141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.598334 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.598163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.619962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.619903 2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:30.621570 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.621549 2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:30.622126 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.622103 2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.695234 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.695209 2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698461 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698577 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698577 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698577 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698577 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.698694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.698588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.774025 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.773996 2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:48:30.774618 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.774605 2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.844843 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.844800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.846962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.846944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:48:30.877882 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:30.877828 2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:48:31.126577 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.126541 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 05:48:31.127240 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.126698 2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 05:48:31.127240 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.126745 2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 05:48:31.127240 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.126762 2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 05:48:31.127240 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.126761 2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ad99878772f894bf595fb87a43495684-6faf233d34787b2e.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-133-0.us-west-1.compute.internal.18e4c180b9ac10f2\": read tcp 10.0.133.0:51152->3.23.163.66:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-133-0.us-west-1.compute.internal.18e4c180b9ac10f2 default 4790 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-0.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:30 +0000 UTC,LastTimestamp:2026-11-04 05:48:30.49909274 +0000 UTC m=+0.694695930,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.us-west-1.compute.internal,}" Nov 04 05:48:31.168445 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.168370 2577 apiserver.go:52] "Watching apiserver" Nov 04 05:48:31.194385 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.194357 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 05:48:31.437035 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.436925 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:31 +0000 UTC" deadline="2028-07-16 19:51:07.873764964 +0000 UTC" Nov 04 05:48:31.437035 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.436976 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14894h2m36.436792177s" Nov 04 05:48:31.500590 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.500560 2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 05:48:31.500919 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.500900 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-tnkp7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54","openshift-cluster-node-tuning-operator/tuned-gxgpb","openshift-dns/node-resolver-d6hqt","openshift-image-registry/node-ca-8rg9n","openshift-multus/multus-nxlbs","kube-system/global-pull-secret-syncer-xpsrx","kube-system/konnectivity-agent-swhsx","openshift-ovn-kubernetes/ovnkube-node-znv7k","kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-tq87s","openshift-multus/network-metrics-daemon-rcfhb","openshift-network-diagnostics/network-check-target-6vqw4"] Nov 04 05:48:31.503516 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.503498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.505643 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.505623 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.508171 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.508152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.510372 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.510353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.512585 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.512569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.514879 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.514863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.517539 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.517524 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.518085 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.518055 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:31.519896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.519880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.522429 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.522414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.524896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.524878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.527115 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.527102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.527189 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.527158 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:31.529351 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.529331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:31.529454 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.529388 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:31.565361 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.565335 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.565486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.565431 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.566245 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.566184 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 05:48:31.566467 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.566429 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\"" Nov 04 05:48:31.567277 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.567253 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 05:48:31.567387 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.567274 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.567387 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.567379 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.567509 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.567416 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\"" Nov 04 05:48:31.569578 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.569545 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.569578 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.569571 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\"" Nov 04 05:48:31.569713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.569608 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.571701 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.571681 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.571959 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.571943 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\"" Nov 04 05:48:31.572018 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.571974 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.574045 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.574027 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\"" Nov 04 05:48:31.574136 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.574117 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 05:48:31.574189 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.574158 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.574320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.574306 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.596509 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.596494 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 05:48:31.605060 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.605148 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605148 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605148 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.605148 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.605320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqb4\" (UniqueName: \"kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.605320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg68w\" (UniqueName: \"kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605713 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85927\" (UniqueName: \"kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.605989 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.605999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjsj\" (UniqueName: \"kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.606540 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdd8l\" (UniqueName: \"kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkht4\" (UniqueName: \"kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4p8v\" (UniqueName: \"kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.607270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfw7q\" (UniqueName: \"kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.606992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.607018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.607049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.607078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.607731 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.607109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.671314 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.671291 2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 05:48:31.671410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.671353 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlq4f" Nov 04 05:48:31.674020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674000 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 05:48:31.674020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674012 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.674180 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674167 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 05:48:31.674262 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674223 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 05:48:31.674382 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674367 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674524 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674549 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674556 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674561 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674616 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 05:48:31.674736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674687 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674842 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674849 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674864 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674866 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674882 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674883 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\"" Nov 04 05:48:31.675015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.674898 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\"" Nov 04 05:48:31.707607 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.707607 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.707607 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.707809 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg68w\" (UniqueName: \"kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.707953 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.707970 2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.708078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:48:32.208033443 +0000 UTC m=+2.403636642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:31.708134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.708694 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708471 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85927\" (UniqueName: \"kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjsj\" (UniqueName: \"kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.709567 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.708988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.710315 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.709339 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.709396 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:32.209377152 +0000 UTC m=+2.404980350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.711130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdd8l\" (UniqueName: \"kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkht4\" (UniqueName: \"kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4p8v\" (UniqueName: \"kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.711726 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.709953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfw7q\" (UniqueName: \"kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.712410 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.710977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.712962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqb4\" (UniqueName: \"kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.711828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.712359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.712377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.712791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.713468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.713104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.784324 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.784290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg68w\" (UniqueName: \"kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.787781 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.787757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85927\" (UniqueName: \"kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:31.790225 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.790195 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:31.790353 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.790243 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:31.790353 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.790260 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:31.790484 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:31.790354 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:32.290331103 +0000 UTC m=+2.485934305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:31.791243 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.791216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjsj\" (UniqueName: \"kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.791488 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.791461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdd8l\" (UniqueName: \"kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.791937 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.791917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.792756 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.792731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfw7q\" (UniqueName: \"kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.793131 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.793106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkht4\" (UniqueName: \"kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.793357 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.793334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqb4\" (UniqueName: \"kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.794082 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.794055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4p8v\" (UniqueName: \"kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:31.836623 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.836589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:48:31.856534 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.856507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:48:31.869921 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.869898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:48:31.876769 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.876747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:48:31.902299 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.902270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:48:31.922382 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.922355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxlbs" Nov 04 05:48:31.941922 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.941897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:31.979663 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.979633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:31.985917 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:31.985896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:48:32.060453 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.060420 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf094e9921d2f7c68bdccfd2d0136c26f.slice/crio-4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e WatchSource:0}: Error finding container 4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e: Status 404 returned error can't find the container with id 4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e Nov 04 05:48:32.060931 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.060907 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a153c0e32e7dc1a08e4a5a7277831c.slice/crio-71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0 WatchSource:0}: Error finding container 71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0: Status 404 returned error can't find the container with id 71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0 Nov 04 05:48:32.065914 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.065898 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:48:32.214378 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.214355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:32.214918 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.214396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:32.214918 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.214487 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:32.214918 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.214498 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:32.214918 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.214536 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:33.214521689 +0000 UTC m=+3.410124878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:32.214918 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.214550 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:48:33.214542452 +0000 UTC m=+3.410145627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:32.315841 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.315732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:32.315979 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.315920 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:32.315979 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.315940 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:32.315979 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.315952 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:32.316101 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:32.316001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:33.315988427 +0000 UTC m=+3.511591607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:32.410712 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.410658 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerStarted","Data":"71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0"} Nov 04 05:48:32.411663 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.411640 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"f094e9921d2f7c68bdccfd2d0136c26f","Type":"ContainerStarted","Data":"4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e"} Nov 04 05:48:32.516814 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.516788 2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:32.674304 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.674196 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:32 +0000 UTC" deadline="2028-05-31 20:22:44.447848911 +0000 UTC" Nov 04 05:48:32.674304 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.674244 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13790h34m11.773608046s" Nov 04 05:48:32.722193 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.722163 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e10948_a9fa_4c51_bf42_20737f98c93b.slice/crio-bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645 WatchSource:0}: Error finding container bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645: Status 404 returned error can't find the container with id bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645 Nov 04 05:48:32.742130 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.742104 2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:32.748420 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:32.748397 2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:32.755215 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.755180 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65672e16_9e00_4ac7_85fa_5bcfe335cf5e.slice/crio-78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93 WatchSource:0}: Error finding container 78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93: Status 404 returned error can't find the container with id 78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93 Nov 04 05:48:32.808829 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.808792 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149702ab_12dd_47a1_80b5_efbe1efad1af.slice/crio-1b11b39e9580a4564df7d743d4ce79aadf2c71f2cc356bbc34312c4c03e0881f WatchSource:0}: Error finding container 1b11b39e9580a4564df7d743d4ce79aadf2c71f2cc356bbc34312c4c03e0881f: Status 404 returned error can't find the container with id 1b11b39e9580a4564df7d743d4ce79aadf2c71f2cc356bbc34312c4c03e0881f Nov 04 05:48:32.810201 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.810143 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc656f1_a57e_4676_a1e7_12d09a6186c7.slice/crio-136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e WatchSource:0}: Error finding container 136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e: Status 404 returned error can't find the container with id 136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e Nov 04 05:48:32.878924 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.878900 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207d14c9_591c_48e1_83a0_4ef555a1060c.slice/crio-5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868 WatchSource:0}: Error finding container 5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868: Status 404 returned error can't find the container with id 5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868 Nov 04 05:48:32.908648 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.908621 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7204797_c3d2_45b2_b664_d7719428b23a.slice/crio-0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714 WatchSource:0}: Error finding container 0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714: Status 404 returned error can't find the container with id 0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714 Nov 04 05:48:32.917635 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.917608 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a037747_8bc9_4521_bf55_cc2bfabbf819.slice/crio-8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199 WatchSource:0}: Error finding container 8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199: Status 404 returned error can't find the container with id 8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199 Nov 04 05:48:32.918350 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.918326 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fa3018_a250_4075_a258_3a8061e11466.slice/crio-174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41 WatchSource:0}: Error finding container 174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41: Status 404 returned error can't find the container with id 174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41 Nov 04 05:48:32.976479 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:48:32.976449 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64f4769_591b_4958_8c40_1fc53f719b6e.slice/crio-181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442 WatchSource:0}: Error finding container 181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442: Status 404 returned error can't find the container with id 181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442 Nov 04 05:48:33.222361 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.222317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:33.223018 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.222389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:33.223018 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.222542 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:33.223018 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.222599 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.222586576 +0000 UTC m=+5.418189752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:33.223018 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.222646 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:33.223018 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.222670 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.222662714 +0000 UTC m=+5.418265890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:33.323229 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.323143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:33.323406 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.323324 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:33.323406 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.323347 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:33.323406 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.323358 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:33.323600 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.323420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.323400554 +0000 UTC m=+5.519003749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:33.406628 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.406596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:33.406825 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.406728 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:33.406825 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.406822 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:33.406979 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.406889 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:33.406979 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.406943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:33.407088 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:33.407007 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:33.415483 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.415407 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swhsx" event={"ID":"7a037747-8bc9-4521-bf55-cc2bfabbf819","Type":"ContainerStarted","Data":"8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199"} Nov 04 05:48:33.417097 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.417067 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d6hqt" event={"ID":"2fc656f1-a57e-4676-a1e7-12d09a6186c7","Type":"ContainerStarted","Data":"136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e"} Nov 04 05:48:33.420031 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.420006 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" event={"ID":"149702ab-12dd-47a1-80b5-efbe1efad1af","Type":"ContainerStarted","Data":"1b11b39e9580a4564df7d743d4ce79aadf2c71f2cc356bbc34312c4c03e0881f"} Nov 04 05:48:33.421530 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.421496 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" event={"ID":"65672e16-9e00-4ac7-85fa-5bcfe335cf5e","Type":"ContainerStarted","Data":"78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93"} Nov 04 05:48:33.422899 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.422867 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnkp7" event={"ID":"27e10948-a9fa-4c51-bf42-20737f98c93b","Type":"ContainerStarted","Data":"bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645"} Nov 04 05:48:33.424838 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.424812 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8rg9n" event={"ID":"b64f4769-591b-4958-8c40-1fc53f719b6e","Type":"ContainerStarted","Data":"181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442"} Nov 04 05:48:33.426812 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.426783 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerStarted","Data":"174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41"} Nov 04 05:48:33.428306 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.428279 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714"} Nov 04 05:48:33.429869 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.429835 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxlbs" event={"ID":"207d14c9-591c-48e1-83a0-4ef555a1060c","Type":"ContainerStarted","Data":"5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868"} Nov 04 05:48:33.675173 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.675069 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:32 +0000 UTC" deadline="2028-08-07 19:32:10.690167064 +0000 UTC" Nov 04 05:48:33.675173 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:33.675130 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15421h43m37.015041996s" Nov 04 05:48:35.237670 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.237302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:35.237670 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.237387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:35.237670 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.237529 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:35.237670 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.237594 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:48:39.237572942 +0000 UTC m=+9.433176118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:35.237670 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.237672 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:35.238501 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.237710 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:39.2376966 +0000 UTC m=+9.433299781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:35.339356 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.339278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:35.339523 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.339428 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:35.339523 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.339442 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:35.339523 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.339454 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:35.339523 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.339498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:39.33948535 +0000 UTC m=+9.535088526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:35.407280 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.407244 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:35.407471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.407401 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:35.407471 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.407468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:35.407598 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.407551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:35.407661 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:35.407616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:35.407718 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:35.407701 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:36.459291 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:36.459011 2577 generic.go:356] "Generic (PLEG): container finished" podID="e6a153c0e32e7dc1a08e4a5a7277831c" containerID="5b97558eceb1f1d83b5fe473806a1e8a0a250d18b33575e372480e1cbf33e1f4" exitCode=0 Nov 04 05:48:36.459844 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:36.459337 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerDied","Data":"5b97558eceb1f1d83b5fe473806a1e8a0a250d18b33575e372480e1cbf33e1f4"} Nov 04 05:48:36.466070 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:36.466032 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"f094e9921d2f7c68bdccfd2d0136c26f","Type":"ContainerStarted","Data":"bc0b9a56121d88c1558550f75b3bb055d40d5f160ab0a28431e2c0c1e7b4b56a"} Nov 04 05:48:36.730036 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:36.729968 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" podStartSLOduration=5.729945666 podStartE2EDuration="5.729945666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:36.729287203 +0000 UTC m=+6.924890404" watchObservedRunningTime="2026-11-04 05:48:36.729945666 +0000 UTC m=+6.925548867" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.407203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:37.407367 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.407455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:37.407536 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.407602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:37.407729 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:37.407677 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:37.473735 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.472761 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="c6496880c655474cf28de81620582716e88fc93d5269a53cd06f352fbe35b61b" exitCode=0 Nov 04 05:48:37.473735 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.472896 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"c6496880c655474cf28de81620582716e88fc93d5269a53cd06f352fbe35b61b"} Nov 04 05:48:37.483286 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.483257 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerStarted","Data":"3417b5e951588c662885fc939544e711bf629784baf0513f3ad0ae8c1aa0e4ff"} Nov 04 05:48:37.869565 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:37.869499 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" podStartSLOduration=6.86948441 podStartE2EDuration="6.86948441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:37.869142643 +0000 UTC m=+8.064745842" watchObservedRunningTime="2026-11-04 05:48:37.86948441 +0000 UTC m=+8.065087607" Nov 04 05:48:38.487568 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:38.487530 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swhsx" event={"ID":"7a037747-8bc9-4521-bf55-cc2bfabbf819","Type":"ContainerStarted","Data":"6c4a0691d1fecdc6646bb46fb4bf590d1321c1ebc40f5788df5b39be9ab97fea"} Nov 04 05:48:39.150921 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.150723 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:39.151555 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.151324 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:39.277255 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.277161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:39.277573 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.277540 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:39.277692 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.277624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:47.277600728 +0000 UTC m=+17.473203928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:39.278084 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.277781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:39.278084 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.277912 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:39.278084 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.277957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:48:47.277942566 +0000 UTC m=+17.473545745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:39.286822 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.285728 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swhsx" podStartSLOduration=3.415881464 podStartE2EDuration="8.285710165s" totalImagesPullingTime="4.869828701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:38.622424462 +0000 UTC m=+8.818027661" watchObservedRunningTime="2026-11-04 05:48:39.285710165 +0000 UTC m=+9.481313362" Nov 04 05:48:39.378640 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.378268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:39.378640 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.378463 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:39.378640 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.378482 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:39.378640 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.378495 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:39.378640 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.378552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:47.37853326 +0000 UTC m=+17.574136452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.407470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.407610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.407683 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.407772 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.407837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:39.407957 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:39.407917 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:39.492418 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.491998 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8rg9n" event={"ID":"b64f4769-591b-4958-8c40-1fc53f719b6e","Type":"ContainerStarted","Data":"848cb64db0b9fe83b19f6d43cc3e94c291c82361c62c5782c638c19d2ed180e0"} Nov 04 05:48:39.492418 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.492169 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:39.493853 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.493688 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:48:39.764165 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:39.764111 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8rg9n" podStartSLOduration=2.675420892 podStartE2EDuration="8.764089936s" totalImagesPullingTime="6.088669044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:39.627018053 +0000 UTC m=+9.822621254" watchObservedRunningTime="2026-11-04 05:48:39.764089936 +0000 UTC m=+9.959693140" Nov 04 05:48:40.497923 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:40.497875 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" event={"ID":"65672e16-9e00-4ac7-85fa-5bcfe335cf5e","Type":"ContainerStarted","Data":"57804877cff966a82e106c379939795f37de576c369aba6c247b7f517797dbb9"} Nov 04 05:48:41.407651 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:41.407614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:41.407843 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:41.407766 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:41.407918 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:41.407859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:41.408020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:41.407995 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:41.408100 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:41.408068 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:41.408166 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:41.408145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:42.008208 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.005377 2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 05:48:42.410846 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.410680 2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:48:42.005394859Z","UUID":"fef5d2e9-04d8-461d-a46e-90262008eb4c","Handler":null,"Name":"","Endpoint":""} Nov 04 05:48:42.412185 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.412167 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 05:48:42.412261 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.412198 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 05:48:42.503626 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.503592 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxlbs" event={"ID":"207d14c9-591c-48e1-83a0-4ef555a1060c","Type":"ContainerStarted","Data":"1aa601dfba155ebb1f5237f4036a5e1086ec277714b8c7f37afb49841408c3a7"} Nov 04 05:48:42.505693 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.505665 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d6hqt" event={"ID":"2fc656f1-a57e-4676-a1e7-12d09a6186c7","Type":"ContainerStarted","Data":"1f72bf46137e72baa07175979d27fde84cb5ae0d94d065562ef52c7607733fa4"} Nov 04 05:48:42.507871 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.507850 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" event={"ID":"65672e16-9e00-4ac7-85fa-5bcfe335cf5e","Type":"ContainerStarted","Data":"7100bb95b2bee164a714fc22320add4c71f98ae613abc54b951be1efb9b8b868"} Nov 04 05:48:42.631785 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.631553 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-nxlbs" podStartSLOduration=2.649726717 podStartE2EDuration="11.631540104s" totalImagesPullingTime="8.981813387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:42.631096544 +0000 UTC m=+12.826699743" watchObservedRunningTime="2026-11-04 05:48:42.631540104 +0000 UTC m=+12.827143297" Nov 04 05:48:42.757564 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:42.757505 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-d6hqt" podStartSLOduration=2.58500659 podStartE2EDuration="11.757490684s" totalImagesPullingTime="9.172484094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:42.757210336 +0000 UTC m=+12.952813533" watchObservedRunningTime="2026-11-04 05:48:42.757490684 +0000 UTC m=+12.953093880" Nov 04 05:48:43.406676 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.406643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:43.407011 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:43.406800 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:43.407011 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.406857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:43.407011 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:43.406904 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:43.407011 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.406943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:43.407011 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:43.406984 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:43.515105 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.515033 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" event={"ID":"65672e16-9e00-4ac7-85fa-5bcfe335cf5e","Type":"ContainerStarted","Data":"cca71e35785d2ea4581ff9e3367b5d3b0da89e7034f57027e65b58407de70ebf"} Nov 04 05:48:43.517629 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.516981 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnkp7" event={"ID":"27e10948-a9fa-4c51-bf42-20737f98c93b","Type":"ContainerStarted","Data":"461f48ebc0374d71c4e2b7fa86ed539097385a0c32915a126f0487727cba3c57"} Nov 04 05:48:43.520751 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.519615 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="8ea1e1740fe96af74d65341deb4417a2f94b387c1024a6efbc3d8d9dc3cc8e6d" exitCode=0 Nov 04 05:48:43.520751 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.520494 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"8ea1e1740fe96af74d65341deb4417a2f94b387c1024a6efbc3d8d9dc3cc8e6d"} Nov 04 05:48:43.640522 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:43.640458 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tnkp7" podStartSLOduration=3.5852829059999998 podStartE2EDuration="12.64044084s" totalImagesPullingTime="9.055157934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:43.640313271 +0000 UTC m=+13.835916472" watchObservedRunningTime="2026-11-04 05:48:43.64044084 +0000 UTC m=+13.836044038" Nov 04 05:48:44.524754 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:44.524186 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" event={"ID":"149702ab-12dd-47a1-80b5-efbe1efad1af","Type":"ContainerStarted","Data":"17e6d1beea8ef77920aad584c9e425feddfc6e413d4936c98b81482a0340ff32"} Nov 04 05:48:44.650917 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:44.650872 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" podStartSLOduration=2.707275265 podStartE2EDuration="13.650857534s" totalImagesPullingTime="10.943582269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:44.650336992 +0000 UTC m=+14.845940192" watchObservedRunningTime="2026-11-04 05:48:44.650857534 +0000 UTC m=+14.846460734" Nov 04 05:48:44.776840 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:44.776752 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" podStartSLOduration=3.481471362 podStartE2EDuration="13.776716929s" totalImagesPullingTime="10.295245567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:44.776461849 +0000 UTC m=+14.972065045" watchObservedRunningTime="2026-11-04 05:48:44.776716929 +0000 UTC m=+14.972320126" Nov 04 05:48:45.406846 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:45.406814 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:45.407022 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:45.406907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:45.407022 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:45.406924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:45.407137 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:45.407055 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:45.407183 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:45.407138 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:45.407322 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:45.407283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:45.529358 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:45.529324 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="ff44bd78e0f05abf3fc4f39cdb6ace60a541ba856bde3be377b67db391fad91f" exitCode=0 Nov 04 05:48:45.530075 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:45.529367 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"ff44bd78e0f05abf3fc4f39cdb6ace60a541ba856bde3be377b67db391fad91f"} Nov 04 05:48:47.344800 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.344585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:47.345243 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.344848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:47.345243 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.344775 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:47.345243 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.344947 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:03.344924849 +0000 UTC m=+33.540528039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:47.345243 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.344976 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:47.345243 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.345013 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret podName:476606ea-919f-4515-9203-8b2037dc7c51 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:03.345002256 +0000 UTC m=+33.540605431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret") pod "global-pull-secret-syncer-xpsrx" (UID: "476606ea-919f-4515-9203-8b2037dc7c51") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:47.406763 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.406717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:47.406924 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.406768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:47.406924 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.406768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:47.406924 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.406854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:47.407077 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.406943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:47.407077 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.407035 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:47.445944 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.445914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:47.446106 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.446042 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:47.446106 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.446056 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:47.446106 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.446069 2577 projected.go:196] Error preparing data for projected volume kube-api-access-nm2rq for pod openshift-network-diagnostics/network-check-target-6vqw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:47.446268 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:47.446129 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq podName:f787e527-00b4-405e-8c51-3df6dea1f644 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:03.44611297 +0000 UTC m=+33.641716148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm2rq" (UniqueName: "kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq") pod "network-check-target-6vqw4" (UID: "f787e527-00b4-405e-8c51-3df6dea1f644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:47.537305 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.537262 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="516e448f86765eb545041f6e5af192873ff68f3eef65b77a3e7ae28de0656e65" exitCode=0 Nov 04 05:48:47.537476 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:47.537326 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"516e448f86765eb545041f6e5af192873ff68f3eef65b77a3e7ae28de0656e65"} Nov 04 05:48:48.542607 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542426 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"3343e02efede8c826e759dceb5a00abfd6b0e12cb56f2032c20d95dcc2df1b22"} Nov 04 05:48:48.543078 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542644 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"1224aad02964da7886a1024e486d7640a0cb38f2479d8bfc8802a04252b5e51e"} Nov 04 05:48:48.543078 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542682 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"57166f913c91ef0b7ba8117c0175a4fb3f5e3cc46d3e8598b097ad2e15c99122"} Nov 04 05:48:48.543078 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542710 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"1348d5d2c92324388e09b84e88557769972d26ee7110081b85008a02a195bb10"} Nov 04 05:48:48.543078 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542759 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"5f0f4860f41de272ac4f8fd26c7c8f1b4bfa37df955a0e2bfc09e40cc8df5c13"} Nov 04 05:48:48.543078 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:48.542787 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"93781505d0e8004652433c4eab0adc0925418f3bfecc8f0ff1efd199abf97260"} Nov 04 05:48:49.406771 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:49.406740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:49.406771 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:49.406757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:49.407035 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:49.406898 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:49.407267 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:49.407250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:49.407377 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:49.407358 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:49.407468 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:49.407451 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:50.549869 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:50.549828 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="c60c5e34477880d34cc8d7ea4feed3d366711cab09fd5db6f6e5b50dcab5d4da" exitCode=0 Nov 04 05:48:50.550457 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:50.549921 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"c60c5e34477880d34cc8d7ea4feed3d366711cab09fd5db6f6e5b50dcab5d4da"} Nov 04 05:48:50.553208 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:50.553185 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"73961aa7892f04003c2bf13540eeccfa409a956a3197cc59d3cc281b91db1662"} Nov 04 05:48:51.406958 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:51.406925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:51.406958 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:51.406961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:51.406958 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:51.406963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:51.407230 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:51.407039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:51.407230 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:51.407116 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:51.407230 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:51.407215 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:51.558143 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:51.558107 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="efe2ea30a89e19f416c1f9ba46600c54cf3500ad54eb9e295bba5685cfead292" exitCode=0 Nov 04 05:48:51.558508 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:51.558160 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerDied","Data":"efe2ea30a89e19f416c1f9ba46600c54cf3500ad54eb9e295bba5685cfead292"} Nov 04 05:48:52.563264 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.563088 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq87s" event={"ID":"f8fa3018-a250-4075-a258-3a8061e11466","Type":"ContainerStarted","Data":"1577af20cae09c319208c36faf4d4b0b1930471aadbd3f03da47fa332fd0d081"} Nov 04 05:48:52.566658 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.566635 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" event={"ID":"b7204797-c3d2-45b2-b664-d7719428b23a","Type":"ContainerStarted","Data":"c5ea8ad6cd06b0b42319c9bb287375cd408a76383f5cb72f9314de8d797d7376"} Nov 04 05:48:52.569380 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.568259 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:52.569380 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.568423 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:52.586353 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.586325 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:52.586959 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.586940 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:52.694627 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.694517 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tq87s" podStartSLOduration=8.400828779 podStartE2EDuration="21.694504682s" totalImagesPullingTime="13.293675903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:52.694181843 +0000 UTC m=+22.889785039" watchObservedRunningTime="2026-11-04 05:48:52.694504682 +0000 UTC m=+22.890107875" Nov 04 05:48:52.832336 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:52.832292 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" podStartSLOduration=6.910340221 podStartE2EDuration="21.832280104s" totalImagesPullingTime="14.921939883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:52.831899014 +0000 UTC m=+23.027502233" watchObservedRunningTime="2026-11-04 05:48:52.832280104 +0000 UTC m=+23.027883300" Nov 04 05:48:53.406699 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:53.406667 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:53.406901 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:53.406741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:53.406901 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:53.406826 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:53.406901 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:53.406835 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:53.407013 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:53.406908 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:53.407013 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:53.406965 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:53.568531 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:53.568497 2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:48:54.570640 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:54.570612 2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:48:55.260294 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.260268 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xpsrx"] Nov 04 05:48:55.260441 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.260369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:55.260478 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:55.260455 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:55.262865 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.262836 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rcfhb"] Nov 04 05:48:55.262982 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.262930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:55.263039 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:55.263018 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:55.316316 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.316283 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6vqw4"] Nov 04 05:48:55.316627 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.316610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:55.316947 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:55.316922 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:55.938580 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:55.938546 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:48:57.406918 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:57.406887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:57.407311 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:57.406978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:57.407311 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:57.406990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:57.407311 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:57.407073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:57.407311 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:57.407214 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:48:57.407311 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:57.407284 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:59.406926 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:59.406893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:48:59.407333 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:59.406999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:48:59.407333 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:59.407008 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcfhb" podUID="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" Nov 04 05:48:59.407333 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:48:59.407033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:48:59.407333 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:59.407111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vqw4" podUID="f787e527-00b4-405e-8c51-3df6dea1f644" Nov 04 05:48:59.407333 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:48:59.407200 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xpsrx" podUID="476606ea-919f-4515-9203-8b2037dc7c51" Nov 04 05:49:00.668030 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.667867 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeReady" Nov 04 05:49:00.668374 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.668131 2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 05:49:00.844773 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.844737 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ktphf"] Nov 04 05:49:00.846370 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.846355 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkpc2"] Nov 04 05:49:00.846484 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.846466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:00.847683 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.847668 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n7dfn"] Nov 04 05:49:00.847815 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.847799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:00.848912 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.848895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:00.854858 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.854836 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx"] Nov 04 05:49:00.856134 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.856118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:00.861159 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.861141 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679"] Nov 04 05:49:00.862887 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.862870 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk"] Nov 04 05:49:00.863485 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.863039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:00.864298 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.864284 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2x2d7"] Nov 04 05:49:00.864405 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.864390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:00.874906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.874883 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c558747f-x6r92"] Nov 04 05:49:00.875024 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.874997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:00.876486 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.876470 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-9x87d"] Nov 04 05:49:00.876618 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.876593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.878153 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.878136 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds"] Nov 04 05:49:00.878260 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.878245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:00.879778 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.879758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:00.900052 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.900035 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:00.901755 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.901738 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:49:00.901866 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.901799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:00.903163 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.903146 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh"] Nov 04 05:49:00.903255 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.903238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:00.905001 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.904985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:00.910003 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.909985 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6t5rr"] Nov 04 05:49:00.911777 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.911758 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4"] Nov 04 05:49:00.911876 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.911859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:00.913288 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.913272 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9g4nv"] Nov 04 05:49:00.913387 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.913373 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:00.914872 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.914855 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qzjcp"] Nov 04 05:49:00.914991 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.914977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:00.916600 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.916584 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ktphf"] Nov 04 05:49:00.916746 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.916614 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n7dfn"] Nov 04 05:49:00.916746 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.916674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:00.916858 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.916762 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkpc2"] Nov 04 05:49:00.917451 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.917433 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx"] Nov 04 05:49:00.918168 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.918148 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679"] Nov 04 05:49:00.918800 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.918786 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2x2d7"] Nov 04 05:49:00.919632 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.919611 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c558747f-x6r92"] Nov 04 05:49:00.920388 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.920375 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:00.921033 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.921016 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzjcp"] Nov 04 05:49:00.944981 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.944955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.945081 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.945081 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:00.945174 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj9bs\" (UniqueName: \"kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs\") pod \"kas-connection-checker-685895c7c9-n7dfn\" (UID: \"528189d9-79b8-4ab9-82b0-88108f123fbd\") " pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:00.945436 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdfmq\" (UniqueName: \"kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.945583 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ch52\" (UniqueName: \"kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:00.945583 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5rjs\" (UniqueName: \"kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs\") pod \"volume-data-source-validator-58c9f5f46d-z7hgk\" (UID: \"7ab49653-7792-4182-afba-ed10eed2d1a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:00.945583 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:00.945776 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.945776 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:00.945776 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:00.945936 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnq75\" (UniqueName: \"kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75\") pod \"kas-connection-checker-685895c7c9-ktphf\" (UID: \"c71ff75b-812f-45b8-9d99-58324eea7954\") " pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:00.945936 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsxht\" (UniqueName: \"kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht\") pod \"kas-connection-checker-685895c7c9-gkpc2\" (UID: \"3ab95ff4-c0b4-4739-8727-3cae87d8b87b\") " pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:00.945936 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:00.946088 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.945992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wsx8\" (UniqueName: \"kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:00.946088 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:00.946234 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:00.946234 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:00.946234 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:00.946385 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfcww\" (UniqueName: \"kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:00.946385 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:00.946385 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:00.946528 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:00.946528 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.946436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrr2\" (UniqueName: \"kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:00.954353 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.954332 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 05:49:00.954475 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.954359 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 05:49:00.954559 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.954488 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 05:49:00.954821 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.954804 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 05:49:00.956075 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.955983 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6t5rr"] Nov 04 05:49:00.956611 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.956589 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-9x87d"] Nov 04 05:49:00.964353 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964331 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 05:49:00.964448 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964366 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 05:49:00.964448 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964397 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:00.964511 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964445 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 05:49:00.964511 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964486 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 05:49:00.964640 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.964618 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:00.966791 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.966763 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4"] Nov 04 05:49:00.966870 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.966809 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds"] Nov 04 05:49:00.967488 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.967475 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk"] Nov 04 05:49:00.968485 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.968464 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh"] Nov 04 05:49:00.971269 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.971252 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9g4nv"] Nov 04 05:49:00.971978 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:00.971962 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:49:01.005615 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005594 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 05:49:01.005708 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005646 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.005708 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005646 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 05:49:01.005708 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005672 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.005708 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005695 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.005947 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005713 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.005947 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005745 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 05:49:01.005947 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005756 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.005947 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005796 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.005947 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005868 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 05:49:01.006126 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.005974 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006126 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006037 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.006126 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006053 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 05:49:01.006126 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006069 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006201 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006201 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006202 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006225 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006276 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.006297 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006284 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006506 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006306 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 05:49:01.006506 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006317 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:01.006506 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.006308 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 05:49:01.046847 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwp7\" (UniqueName: \"kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.046923 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgtmj\" (UniqueName: \"kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.046923 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.046923 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.047014 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.047014 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.046990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.047081 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvb64\" (UniqueName: \"kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64\") pod \"network-check-source-6f78d59f99-bhng4\" (UID: \"ab950d8a-b6ef-497c-8521-63af4c6f6fda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:01.047113 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ch52\" (UniqueName: \"kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.047166 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.047218 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.047208 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:01.047265 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.047320 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfcww\" (UniqueName: \"kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.047320 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.047305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.547276141 +0000 UTC m=+31.742879322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:01.047468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:01.047468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.047468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.047468 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.047647 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.047647 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.047647 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.047647 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.047647 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr65f\" (UniqueName: \"kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.047896 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.047960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.048009 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.547997849 +0000 UTC m=+31.743601023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfmq\" (UniqueName: \"kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5rjs\" (UniqueName: \"kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs\") pod \"volume-data-source-validator-58c9f5f46d-z7hgk\" (UID: \"7ab49653-7792-4182-afba-ed10eed2d1a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:01.048169 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wsx8\" (UniqueName: \"kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnq75\" (UniqueName: \"kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75\") pod \"kas-connection-checker-685895c7c9-ktphf\" (UID: \"c71ff75b-812f-45b8-9d99-58324eea7954\") " pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxht\" (UniqueName: \"kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht\") pod \"kas-connection-checker-685895c7c9-gkpc2\" (UID: \"3ab95ff4-c0b4-4739-8727-3cae87d8b87b\") " pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.048438 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629bn\" (UniqueName: \"kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.048906 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrr2\" (UniqueName: \"kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.048972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.049004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.049114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9bs\" (UniqueName: \"kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs\") pod \"kas-connection-checker-685895c7c9-n7dfn\" (UID: \"528189d9-79b8-4ab9-82b0-88108f123fbd\") " pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:01.049368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.049132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.049635 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.049579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:01.051179 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.051160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.064829 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064808 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 05:49:01.064910 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064849 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 05:49:01.064910 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064899 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064958 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-n5d8l\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064964 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064992 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064995 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065000 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 05:49:01.065028 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064869 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5ph5l\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065037 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065045 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065074 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064974 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.064975 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065113 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065088 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065068 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065130 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 05:49:01.065303 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065271 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 05:49:01.065940 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.065925 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 05:49:01.068314 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.068299 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:01.068382 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.068320 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:01.068382 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.068343 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.568329815 +0000 UTC m=+31.763933019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:01.068382 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.068356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.568350569 +0000 UTC m=+31.763953742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:01.069012 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.068994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.070499 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.070474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.070618 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.070597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.070662 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.070612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.070696 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.070667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.113804 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.113742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ch52\" (UniqueName: \"kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.113804 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.113747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfcww\" (UniqueName: \"kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.114424 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.114398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfmq\" (UniqueName: \"kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.114523 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.114439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxht\" (UniqueName: \"kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht\") pod \"kas-connection-checker-685895c7c9-gkpc2\" (UID: \"3ab95ff4-c0b4-4739-8727-3cae87d8b87b\") " pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:01.114992 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.114974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9bs\" (UniqueName: \"kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs\") pod \"kas-connection-checker-685895c7c9-n7dfn\" (UID: \"528189d9-79b8-4ab9-82b0-88108f123fbd\") " pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:01.115404 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.115390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5rjs\" (UniqueName: \"kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs\") pod \"volume-data-source-validator-58c9f5f46d-z7hgk\" (UID: \"7ab49653-7792-4182-afba-ed10eed2d1a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:01.115736 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.115708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrr2\" (UniqueName: \"kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.115813 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.115796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnq75\" (UniqueName: \"kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75\") pod \"kas-connection-checker-685895c7c9-ktphf\" (UID: \"c71ff75b-812f-45b8-9d99-58324eea7954\") " pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:01.116383 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.116366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wsx8\" (UniqueName: \"kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.149878 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.149851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.149969 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.149883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.149969 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.149901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.149969 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.149932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.150120 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.150120 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr65f\" (UniqueName: \"kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.150222 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.150222 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.150222 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.150222 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.150195 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:01.150222 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.150213 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.150263 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.650243386 +0000 UTC m=+31.845846562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.150459 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150576 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629bn\" (UniqueName: \"kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwp7\" (UniqueName: \"kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtmj\" (UniqueName: \"kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.151317 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.150961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151150 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151212 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.651196308 +0000 UTC m=+31.846799487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151380 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151432 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.651418317 +0000 UTC m=+31.847021505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151505 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.151516 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvb64\" (UniqueName: \"kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64\") pod \"network-check-source-6f78d59f99-bhng4\" (UID: \"ab950d8a-b6ef-497c-8521-63af4c6f6fda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.152020 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.151989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.152760 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.152052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.152760 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.152180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.152760 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.152222 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:01.652206798 +0000 UTC m=+31.847809973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:01.153452 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.153423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.153452 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.153445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.153708 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.153685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.153885 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.153863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.157542 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.155452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.157542 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.155477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.157690 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.157591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:01.158411 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.158389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.163183 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.163164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:01.174425 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.174401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:01.191866 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.191841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:01.197236 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.197208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:01.203110 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.202866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:01.222975 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.218542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.222975 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.219760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvb64\" (UniqueName: \"kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64\") pod \"network-check-source-6f78d59f99-bhng4\" (UID: \"ab950d8a-b6ef-497c-8521-63af4c6f6fda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:01.222975 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.222297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629bn\" (UniqueName: \"kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.223473 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.223448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:01.224772 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.224711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.225936 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.225262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.225936 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.225895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.227930 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.227848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwp7\" (UniqueName: \"kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.228897 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.228860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr65f\" (UniqueName: \"kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.256832 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.256790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtmj\" (UniqueName: \"kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.266835 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.266571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:01.273386 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.273320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:01.407015 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.406987 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:01.407149 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.407039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:01.407149 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.406994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:01.467163 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.466993 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 05:49:01.467270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.467214 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\"" Nov 04 05:49:01.467270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.467214 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\"" Nov 04 05:49:01.467270 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.467248 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\"" Nov 04 05:49:01.467368 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.467307 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 05:49:01.553842 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.553811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:01.556849 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.556829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:01.556970 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.556954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.557030 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.556958 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:01.557094 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.557083 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.557064013 +0000 UTC m=+32.752667202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:01.557156 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.557105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.557095185 +0000 UTC m=+32.752698373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:01.559629 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.559606 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ktphf"] Nov 04 05:49:01.562682 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.562659 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkpc2"] Nov 04 05:49:01.562971 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.562916 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71ff75b_812f_45b8_9d99_58324eea7954.slice/crio-7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211 WatchSource:0}: Error finding container 7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211: Status 404 returned error can't find the container with id 7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211 Nov 04 05:49:01.567141 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.567116 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n7dfn"] Nov 04 05:49:01.571023 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.570548 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528189d9_79b8_4ab9_82b0_88108f123fbd.slice/crio-a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46 WatchSource:0}: Error finding container a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46: Status 404 returned error can't find the container with id a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46 Nov 04 05:49:01.591619 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.591516 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" event={"ID":"3ab95ff4-c0b4-4739-8727-3cae87d8b87b","Type":"ContainerStarted","Data":"814d2a602def87aba2e51a2d0ad055b2e38d6a69b7290cc0f72efde51b2912df"} Nov 04 05:49:01.595480 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.595404 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ktphf" event={"ID":"c71ff75b-812f-45b8-9d99-58324eea7954","Type":"ContainerStarted","Data":"7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211"} Nov 04 05:49:01.598053 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.596787 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" event={"ID":"528189d9-79b8-4ab9-82b0-88108f123fbd","Type":"ContainerStarted","Data":"a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46"} Nov 04 05:49:01.624935 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.624506 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679"] Nov 04 05:49:01.636401 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.636363 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda984a632_aac0_4b55_8e45_5da4ff687d91.slice/crio-1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a WatchSource:0}: Error finding container 1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a: Status 404 returned error can't find the container with id 1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a Nov 04 05:49:01.641820 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.640165 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds"] Nov 04 05:49:01.645897 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.645867 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714fc0ae_5c6c_4738_8bea_54bf573f85ff.slice/crio-b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a WatchSource:0}: Error finding container b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a: Status 404 returned error can't find the container with id b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a Nov 04 05:49:01.658551 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.658501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:01.658868 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.658784 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:01.659057 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.658803 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:01.660678 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.660577 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk"] Nov 04 05:49:01.660678 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.658966 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.658944472 +0000 UTC m=+32.854547648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:01.661043 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.660989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:01.661311 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.661210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:01.661311 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.661276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:01.661629 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.661527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:01.661831 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.661721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662033 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662156 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.662137822 +0000 UTC m=+32.857741016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662230 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662265 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.66225346 +0000 UTC m=+32.857856639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662320 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662350 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.662340719 +0000 UTC m=+32.857943907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662422 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.66243987 +0000 UTC m=+32.858043044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662510 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662520 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:01.662548 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:02.662538636 +0000 UTC m=+32.858141812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:01.664962 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.664910 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2x2d7"] Nov 04 05:49:01.668030 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.668000 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe228dc0_014f_43a6_99c9_dfc7cdd45b37.slice/crio-7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43 WatchSource:0}: Error finding container 7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43: Status 404 returned error can't find the container with id 7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43 Nov 04 05:49:01.672007 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.671961 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab49653_7792_4182_afba_ed10eed2d1a1.slice/crio-3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb WatchSource:0}: Error finding container 3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb: Status 404 returned error can't find the container with id 3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb Nov 04 05:49:01.701396 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.701139 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4"] Nov 04 05:49:01.706212 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.706146 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab950d8a_b6ef_497c_8521_63af4c6f6fda.slice/crio-ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9 WatchSource:0}: Error finding container ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9: Status 404 returned error can't find the container with id ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9 Nov 04 05:49:01.711227 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.711203 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzjcp"] Nov 04 05:49:01.714627 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.714602 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d3250c_1086_420a_8645_e9eb443bf85f.slice/crio-5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c WatchSource:0}: Error finding container 5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c: Status 404 returned error can't find the container with id 5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c Nov 04 05:49:01.957897 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:01.957863 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6t5rr"] Nov 04 05:49:01.960664 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:01.960635 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b905f9_e91d_4a54_b373_460596807036.slice/crio-6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f WatchSource:0}: Error finding container 6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f: Status 404 returned error can't find the container with id 6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f Nov 04 05:49:02.570112 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.570079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:02.570328 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.570172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:02.570328 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.570229 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:02.570328 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.570298 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.570283823 +0000 UTC m=+34.765887001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:02.570328 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.570317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.570307845 +0000 UTC m=+34.765911023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:02.600882 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.600847 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ktphf" event={"ID":"c71ff75b-812f-45b8-9d99-58324eea7954","Type":"ContainerStarted","Data":"835db2ef3c9685c7392d69a6480e711a932b53b01e25f250648db193229a37ae"} Nov 04 05:49:02.602004 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.601980 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" event={"ID":"ab950d8a-b6ef-497c-8521-63af4c6f6fda","Type":"ContainerStarted","Data":"ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9"} Nov 04 05:49:02.603190 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.603160 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" event={"ID":"714fc0ae-5c6c-4738-8bea-54bf573f85ff","Type":"ContainerStarted","Data":"b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a"} Nov 04 05:49:02.604566 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.604539 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerStarted","Data":"7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43"} Nov 04 05:49:02.606143 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.606092 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" event={"ID":"7ab49653-7792-4182-afba-ed10eed2d1a1","Type":"ContainerStarted","Data":"3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb"} Nov 04 05:49:02.608135 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.608113 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" event={"ID":"f0b905f9-e91d-4a54-b373-460596807036","Type":"ContainerStarted","Data":"6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f"} Nov 04 05:49:02.609942 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.609900 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" event={"ID":"528189d9-79b8-4ab9-82b0-88108f123fbd","Type":"ContainerStarted","Data":"2bccd09250275bac604c1dea4ebde7f1def08bceee33bcaa92b26714630e2c95"} Nov 04 05:49:02.611867 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.611843 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzjcp" event={"ID":"f4d3250c-1086-420a-8645-e9eb443bf85f","Type":"ContainerStarted","Data":"5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c"} Nov 04 05:49:02.613458 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.613413 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" event={"ID":"a984a632-aac0-4b55-8e45-5da4ff687d91","Type":"ContainerStarted","Data":"1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a"} Nov 04 05:49:02.616008 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.615531 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" event={"ID":"3ab95ff4-c0b4-4739-8727-3cae87d8b87b","Type":"ContainerStarted","Data":"6e7962688cefd983b94423ab0818cc36abb9b2337507e96819390c522d84c10f"} Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:02.671831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.671987 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672066217 +0000 UTC m=+34.867669395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672207 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672221 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672263 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672249201 +0000 UTC m=+34.867852381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672329 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672365 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672355286 +0000 UTC m=+34.867958460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672683 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672749 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672722503 +0000 UTC m=+34.868325677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:02.673062 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672809 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:02.674284 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672832 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672824572 +0000 UTC m=+34.868427746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:02.674284 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672881 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:02.674284 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672889 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:02.674284 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:02.672909 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.672903339 +0000 UTC m=+34.868506527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:03.196598 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.195848 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" podStartSLOduration=409.195828912 podStartE2EDuration="6m49.195828912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:03.194162384 +0000 UTC m=+33.389765612" watchObservedRunningTime="2026-11-04 05:49:03.195828912 +0000 UTC m=+33.391432111" Nov 04 05:49:03.387555 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.386412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:03.387555 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.386609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:03.387555 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:03.386764 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:03.387555 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:03.386834 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:35.386818257 +0000 UTC m=+65.582421436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:03.404901 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.404833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:03.446446 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.445000 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-ktphf" podStartSLOduration=409.444980502 podStartE2EDuration="6m49.444980502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:03.320299706 +0000 UTC m=+33.515902903" watchObservedRunningTime="2026-11-04 05:49:03.444980502 +0000 UTC m=+33.640583699" Nov 04 05:49:03.488626 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.488033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:03.499398 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.499373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:03.524492 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.524468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:03.528654 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.528633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:03.951711 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.951603 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" podStartSLOduration=409.951582078 podStartE2EDuration="6m49.951582078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:03.446422795 +0000 UTC m=+33.642025993" watchObservedRunningTime="2026-11-04 05:49:03.951582078 +0000 UTC m=+34.147185275" Nov 04 05:49:03.953279 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.953254 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xpsrx"] Nov 04 05:49:03.969904 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:03.969770 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6vqw4"] Nov 04 05:49:04.601184 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.601153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:04.601345 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.601242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:04.601467 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.601452 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.601434142 +0000 UTC m=+38.797037337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:04.601928 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.601841 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:04.601928 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.601906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.601890227 +0000 UTC m=+38.797493417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:04.628087 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.628026 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xpsrx" event={"ID":"476606ea-919f-4515-9203-8b2037dc7c51","Type":"ContainerStarted","Data":"4adb3c6427520e45088079d229b50850106090f283e2eabb2d32c3f59b072abc"} Nov 04 05:49:04.631773 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.630925 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" event={"ID":"7ab49653-7792-4182-afba-ed10eed2d1a1","Type":"ContainerStarted","Data":"9084214078d6bfbf504a17cafe92f35b324c9193adbe531053b82dec322ba83d"} Nov 04 05:49:04.633970 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.633816 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6vqw4" event={"ID":"f787e527-00b4-405e-8c51-3df6dea1f644","Type":"ContainerStarted","Data":"12fbe36526d09cc87f0c8fef7b1358fd2fb0530a9602c42cc1bc66cda0ebd20a"} Nov 04 05:49:04.702373 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:04.702373 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:04.702579 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:04.702579 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:04.702579 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:04.702579 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:04.702550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702808 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702886 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702885 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702945 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702948 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702959 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702967 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:04.702993 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702951 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.702932951 +0000 UTC m=+38.898536142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.703014 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.703001225 +0000 UTC m=+38.898604404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.702894 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.703032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.703022984 +0000 UTC m=+38.898626158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.703058 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.703048092 +0000 UTC m=+38.898651272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.703073 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.703064895 +0000 UTC m=+38.898668073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:04.703471 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:04.703088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:08.703079699 +0000 UTC m=+38.898682873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:06.644987 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.644948 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" event={"ID":"714fc0ae-5c6c-4738-8bea-54bf573f85ff","Type":"ContainerStarted","Data":"2740b8396e5d8ddb775d8d8b60332e66342f17eb948a900c66345ea434221dbe"} Nov 04 05:49:06.649138 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.649110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/0.log" Nov 04 05:49:06.649275 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.649153 2577 generic.go:356] "Generic (PLEG): container finished" podID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerID="c39862326b3d280e2fc29ef6bcc058f608f0109781c86881a5a18aac7b19cb36" exitCode=255 Nov 04 05:49:06.649275 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.649233 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerDied","Data":"c39862326b3d280e2fc29ef6bcc058f608f0109781c86881a5a18aac7b19cb36"} Nov 04 05:49:06.649549 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.649532 2577 scope.go:122] "RemoveContainer" containerID="c39862326b3d280e2fc29ef6bcc058f608f0109781c86881a5a18aac7b19cb36" Nov 04 05:49:06.774805 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.771060 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" podStartSLOduration=380.450905475 podStartE2EDuration="6m22.771036437s" totalImagesPullingTime="2.320130962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:04.757833594 +0000 UTC m=+34.953436791" watchObservedRunningTime="2026-11-04 05:49:06.771036437 +0000 UTC m=+36.966639659" Nov 04 05:49:06.774805 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:06.772461 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" podStartSLOduration=370.930316986 podStartE2EDuration="6m15.772447364s" totalImagesPullingTime="4.842130378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:06.770523893 +0000 UTC m=+36.966127090" watchObservedRunningTime="2026-11-04 05:49:06.772447364 +0000 UTC m=+36.968050561" Nov 04 05:49:07.656214 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.656182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:07.656662 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.656640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/0.log" Nov 04 05:49:07.656721 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.656674 2577 generic.go:356] "Generic (PLEG): container finished" podID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" exitCode=255 Nov 04 05:49:07.656812 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.656794 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerDied","Data":"5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097"} Nov 04 05:49:07.656878 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.656865 2577 scope.go:122] "RemoveContainer" containerID="c39862326b3d280e2fc29ef6bcc058f608f0109781c86881a5a18aac7b19cb36" Nov 04 05:49:07.657296 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.657282 2577 scope.go:122] "RemoveContainer" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" Nov 04 05:49:07.657530 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:07.657510 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:07.661475 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.661050 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" event={"ID":"f0b905f9-e91d-4a54-b373-460596807036","Type":"ContainerStarted","Data":"6bf4c38c9e4033b8863c8c423de396c018c333e04617c6b7f4cd591ee9fc1840"} Nov 04 05:49:07.664480 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.664454 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzjcp" event={"ID":"f4d3250c-1086-420a-8645-e9eb443bf85f","Type":"ContainerStarted","Data":"0b78dc0d861669f15e603f1328cce1dc6e8fcbeb8fff75a392104a936460f9e9"} Nov 04 05:49:07.669754 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.669622 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" event={"ID":"a984a632-aac0-4b55-8e45-5da4ff687d91","Type":"ContainerStarted","Data":"c6f2f6ea8b22a8ee98821a67d59388967d716022518d80e47fd3f41148afe7c1"} Nov 04 05:49:07.920805 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:07.918696 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" podStartSLOduration=370.167150322 podStartE2EDuration="6m14.918677084s" totalImagesPullingTime="4.751526762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:07.918098787 +0000 UTC m=+38.113701984" watchObservedRunningTime="2026-11-04 05:49:07.918677084 +0000 UTC m=+38.114280282" Nov 04 05:49:08.045752 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.045645 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" podStartSLOduration=378.959711248 podStartE2EDuration="6m24.045626628s" totalImagesPullingTime="5.08591538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:08.044742999 +0000 UTC m=+38.240346187" watchObservedRunningTime="2026-11-04 05:49:08.045626628 +0000 UTC m=+38.241229825" Nov 04 05:49:08.171191 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.171090 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qzjcp" podStartSLOduration=2.342097402 podStartE2EDuration="8.171072497s" totalImagesPullingTime="5.828975095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:08.169569753 +0000 UTC m=+38.365172944" watchObservedRunningTime="2026-11-04 05:49:08.171072497 +0000 UTC m=+38.366675692" Nov 04 05:49:08.645917 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.645882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:08.646063 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.646042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:08.646393 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.646212 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:08.646393 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.646280 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.646261091 +0000 UTC m=+46.841864286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:08.646393 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.646366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.64635596 +0000 UTC m=+46.841959149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:08.670635 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.668948 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pthc4"] Nov 04 05:49:08.671996 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.671926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.678985 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.678964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:08.682132 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.679305 2577 scope.go:122] "RemoveContainer" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" Nov 04 05:49:08.682132 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.679503 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:08.707533 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.707504 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5"] Nov 04 05:49:08.709341 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.709314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:08.735434 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.734023 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 05:49:08.735434 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.734106 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\"" Nov 04 05:49:08.735434 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.734160 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 05:49:08.746813 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.746780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:08.746949 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.746862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:08.746949 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.746900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:08.746949 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.746927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:08.746949 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.746936 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.746997 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747040 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747048 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747030741 +0000 UTC m=+46.942633915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747061 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747094786 +0000 UTC m=+46.942697960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.747127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:08.747163 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747061 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.747172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747180 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747167011 +0000 UTC m=+46.942770202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747272 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747285 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747311 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747323 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747310476 +0000 UTC m=+46.942913666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747373 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747357727 +0000 UTC m=+46.942960907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:08.747525 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.747410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.747397429 +0000 UTC m=+46.943000617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:08.763505 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.763477 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pthc4"] Nov 04 05:49:08.769436 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.769407 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5"] Nov 04 05:49:08.832667 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.832583 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:08.832864 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.832706 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 05:49:08.832864 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.832829 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58k5t\"" Nov 04 05:49:08.848236 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.848200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pbdc\" (UniqueName: \"kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc\") pod \"migrator-66df5d496b-r88q5\" (UID: \"cc7055f3-cf05-4ec4-b101-3dbb34889de5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:08.848389 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.848246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.848389 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.848292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlk98\" (UniqueName: \"kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.849136 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.848396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.849304 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.849211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.849304 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.849282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.950651 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.950651 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.950651 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.950931 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.950800 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:08.950931 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pbdc\" (UniqueName: \"kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc\") pod \"migrator-66df5d496b-r88q5\" (UID: \"cc7055f3-cf05-4ec4-b101-3dbb34889de5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:08.950931 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.950880 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:09.450859285 +0000 UTC m=+39.646462473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:08.950931 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.951135 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.950971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlk98\" (UniqueName: \"kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.951135 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.950987 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 05:49:08.951135 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:08.951050 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:09.451039964 +0000 UTC m=+39.646643142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : configmap "kube-rbac-proxy" not found Nov 04 05:49:08.951135 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.951081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:08.951482 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:08.951441 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:09.022288 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.022254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlk98\" (UniqueName: \"kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:09.022960 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.022906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pbdc\" (UniqueName: \"kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc\") pod \"migrator-66df5d496b-r88q5\" (UID: \"cc7055f3-cf05-4ec4-b101-3dbb34889de5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:09.024984 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.024791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:09.413357 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.413129 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5"] Nov 04 05:49:09.416185 ip-10-0-133-0 kubenswrapper[2577]: W1104 05:49:09.416154 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7055f3_cf05_4ec4_b101_3dbb34889de5.slice/crio-1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6 WatchSource:0}: Error finding container 1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6: Status 404 returned error can't find the container with id 1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6 Nov 04 05:49:09.466226 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.466186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:09.466361 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.466244 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:09.466361 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:09.466330 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 05:49:09.466454 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:09.466380 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:10.466367069 +0000 UTC m=+40.661970256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : configmap "kube-rbac-proxy" not found Nov 04 05:49:09.466454 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:09.466446 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:09.466560 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:09.466486 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:10.46647406 +0000 UTC m=+40.662077254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:09.683621 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.683591 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" event={"ID":"cc7055f3-cf05-4ec4-b101-3dbb34889de5","Type":"ContainerStarted","Data":"1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6"} Nov 04 05:49:09.685206 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.685180 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" event={"ID":"ab950d8a-b6ef-497c-8521-63af4c6f6fda","Type":"ContainerStarted","Data":"9adbcf0997f560a3b814bda66a0accfa1cdb7a7f6c5d6284d585583ec6b1ca63"} Nov 04 05:49:09.810692 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:09.810639 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" podStartSLOduration=372.908112075 podStartE2EDuration="6m19.810623491s" totalImagesPullingTime="6.902511416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:09.810238804 +0000 UTC m=+40.005842001" watchObservedRunningTime="2026-11-04 05:49:09.810623491 +0000 UTC m=+40.006226686" Nov 04 05:49:10.477678 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:10.477640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:10.477876 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:10.477699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:10.477876 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:10.477822 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 05:49:10.477876 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:10.477850 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:10.478042 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:10.477888 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:12.47787085 +0000 UTC m=+42.673474041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : configmap "kube-rbac-proxy" not found Nov 04 05:49:10.478042 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:10.477916 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:12.477898259 +0000 UTC m=+42.673501450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:10.691460 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:10.691416 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6vqw4" event={"ID":"f787e527-00b4-405e-8c51-3df6dea1f644","Type":"ContainerStarted","Data":"ab2d9b28c3dcb3cb31b7603a06bf21cb7411b0219419433bf5ddbee0040a33d5"} Nov 04 05:49:10.691870 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:10.691503 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:10.817147 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:10.817034 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6vqw4" podStartSLOduration=34.170776739 podStartE2EDuration="39.817019919s" totalImagesPullingTime="5.64624318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:10.816613368 +0000 UTC m=+41.012216571" watchObservedRunningTime="2026-11-04 05:49:10.817019919 +0000 UTC m=+41.012623135" Nov 04 05:49:11.203635 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:11.203607 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:11.203748 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:11.203670 2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:11.204095 ip-10-0-133-0 kubenswrapper[2577]: I1104 05:49:11.204076 2577 scope.go:122] "RemoveContainer" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" Nov 04 05:49:11.204304 ip-10-0-133-0 kubenswrapper[2577]: E1104 05:49:11.204280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:11.435866 ip-10-0-133-0 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 05:49:11.447101 ip-10-0-133-0 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 05:49:11.447263 ip-10-0-133-0 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 05:49:11.447425 ip-10-0-133-0 systemd[1]: kubelet.service: Consumed 2.976s CPU time. Nov 04 05:49:11.461392 ip-10-0-133-0 systemd[1]: Starting Kubernetes Kubelet... Nov 04 05:49:11.534292 ip-10-0-133-0 kubenswrapper[4932]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:49:11.534292 ip-10-0-133-0 kubenswrapper[4932]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 05:49:11.534292 ip-10-0-133-0 kubenswrapper[4932]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:49:11.534292 ip-10-0-133-0 kubenswrapper[4932]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:49:11.536361 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536278 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.536361 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536360 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.536361 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536365 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536368 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536371 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536374 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536376 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536379 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536383 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536385 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536388 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536391 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536394 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536396 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536399 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536402 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536404 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536407 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536409 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536412 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536414 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536417 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.536466 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536419 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536422 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536425 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536428 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536430 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536433 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536435 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536438 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536440 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536443 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536445 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536448 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536451 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536453 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536456 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536459 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536461 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536464 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536467 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536470 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.536976 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536473 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536476 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536478 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536483 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536487 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536490 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536493 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536496 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536505 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536528 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536532 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536535 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536539 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536542 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536546 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536549 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536552 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536554 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536557 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.537456 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536560 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536562 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536565 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536569 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536571 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536574 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536577 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536579 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536582 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536585 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536587 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536590 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536593 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536598 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536601 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536604 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536607 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536609 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536612 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.537932 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536614 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536617 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536619 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536622 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536624 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536626 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536629 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536631 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536634 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536637 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536639 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536642 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536645 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536648 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536651 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536653 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536656 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536658 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536661 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.538394 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536664 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536667 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536671 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536673 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536676 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536679 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.536682 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537481 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537489 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537493 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537496 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537499 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537502 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537505 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537508 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537511 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537513 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537516 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537518 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.538876 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537521 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537524 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537527 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537529 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537532 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537535 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537537 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537540 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537543 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537545 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537548 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537551 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537553 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537556 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537558 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537561 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537563 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537566 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537568 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537571 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.539351 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537573 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537575 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537578 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537581 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537583 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537586 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537589 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537591 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537594 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537596 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537599 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537601 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537604 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537606 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537609 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537611 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537614 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537617 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537619 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537622 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.539853 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537625 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537628 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537630 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537633 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537636 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537638 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537641 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537643 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537646 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537648 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537650 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537653 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537655 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537658 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537660 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537663 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537666 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537668 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537670 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537673 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.540344 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537676 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537679 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537682 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537684 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537687 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537689 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537691 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537694 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537700 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537702 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537705 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537707 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537710 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537713 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537716 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537718 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537721 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537739 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537742 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537746 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.540889 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537748 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537751 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537753 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537756 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537758 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537762 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537766 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537769 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537774 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537777 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537781 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537786 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537788 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.537791 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538318 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538324 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538328 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538331 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538334 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.541382 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538337 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538340 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538343 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538346 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538349 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538352 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538354 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538357 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538360 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538362 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538365 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538367 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538370 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538372 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538375 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538378 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538381 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538383 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538386 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538388 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.541875 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538391 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538394 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538397 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538400 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538403 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538405 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538409 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538412 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538415 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538418 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538420 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538423 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538426 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538429 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538432 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538434 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538437 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538440 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538442 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.542421 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538445 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538447 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538450 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538453 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538455 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538458 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538460 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538463 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538466 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538468 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538470 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538473 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538476 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538478 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538480 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538484 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538489 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538492 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538495 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538497 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.542906 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538500 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538502 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538505 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538508 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538510 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538513 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538515 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538518 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538520 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538523 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538526 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538529 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538531 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538534 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538536 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538539 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538542 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538544 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538547 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.543562 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538551 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538554 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538557 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538560 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538562 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538565 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538567 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538570 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538573 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538577 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538579 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538582 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538585 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538587 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538590 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538592 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538595 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538598 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538600 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.544362 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538603 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538605 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538608 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.538612 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538698 4932 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538710 4932 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538715 4932 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538720 4932 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538740 4932 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538745 4932 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538750 4932 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538754 4932 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538757 4932 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538760 4932 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538764 4932 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538767 4932 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538771 4932 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538774 4932 flags.go:64] FLAG: --cgroup-root="" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538777 4932 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538780 4932 flags.go:64] FLAG: --client-ca-file="" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538783 4932 flags.go:64] FLAG: --cloud-provider="external" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538786 4932 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538792 4932 flags.go:64] FLAG: --cluster-domain="" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538800 4932 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 05:49:11.545202 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538804 4932 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538807 4932 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538811 4932 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538814 4932 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538817 4932 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538820 4932 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538823 4932 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538827 4932 flags.go:64] FLAG: --contention-profiling="false" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538830 4932 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538833 4932 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538836 4932 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538839 4932 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538844 4932 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538847 4932 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538850 4932 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538852 4932 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538855 4932 flags.go:64] FLAG: --enable-server="true" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538858 4932 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538863 4932 flags.go:64] FLAG: --event-burst="100" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538866 4932 flags.go:64] FLAG: --event-qps="50" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538869 4932 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538873 4932 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538876 4932 flags.go:64] FLAG: --eviction-hard="" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538880 4932 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 05:49:11.546251 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538883 4932 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538887 4932 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538890 4932 flags.go:64] FLAG: --eviction-soft="" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538893 4932 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538896 4932 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538899 4932 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538902 4932 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538907 4932 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538911 4932 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538914 4932 flags.go:64] FLAG: --feature-gates="" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538918 4932 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538921 4932 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538924 4932 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538927 4932 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538930 4932 flags.go:64] FLAG: --healthz-port="10248" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538933 4932 flags.go:64] FLAG: --help="false" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538936 4932 flags.go:64] FLAG: --hostname-override="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538940 4932 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538943 4932 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538945 4932 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538949 4932 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538952 4932 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538955 4932 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 05:49:11.547359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538957 4932 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538960 4932 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538963 4932 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538967 4932 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538970 4932 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538973 4932 flags.go:64] FLAG: --kube-reserved="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538976 4932 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538979 4932 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538982 4932 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538985 4932 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538987 4932 flags.go:64] FLAG: --lock-file="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538990 4932 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538993 4932 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.538996 4932 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539001 4932 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539004 4932 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539009 4932 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539012 4932 flags.go:64] FLAG: --logging-format="text" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539015 4932 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539019 4932 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539021 4932 flags.go:64] FLAG: --manifest-url="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539024 4932 flags.go:64] FLAG: --manifest-url-header="" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539029 4932 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539032 4932 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539035 4932 flags.go:64] FLAG: --max-pods="110" Nov 04 05:49:11.548342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539038 4932 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539042 4932 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539045 4932 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539048 4932 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539050 4932 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539053 4932 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539056 4932 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539073 4932 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539077 4932 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539080 4932 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539083 4932 flags.go:64] FLAG: --pod-cidr="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539086 4932 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539089 4932 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539092 4932 flags.go:64] FLAG: --pods-per-core="0" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539095 4932 flags.go:64] FLAG: --port="10250" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539098 4932 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539101 4932 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-03403b7496f60a583" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539104 4932 flags.go:64] FLAG: --qos-reserved="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539107 4932 flags.go:64] FLAG: --read-only-port="10255" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539110 4932 flags.go:64] FLAG: --register-node="true" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539113 4932 flags.go:64] FLAG: --register-with-taints="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539117 4932 flags.go:64] FLAG: --registry-burst="10" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539120 4932 flags.go:64] FLAG: --registry-qps="5" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539125 4932 flags.go:64] FLAG: --reserved-cpus="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539128 4932 flags.go:64] FLAG: --reserved-memory="" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539133 4932 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 05:49:11.549426 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539143 4932 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539147 4932 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539150 4932 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539152 4932 flags.go:64] FLAG: --runonce="false" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539155 4932 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539158 4932 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539161 4932 flags.go:64] FLAG: --seccomp-default="false" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539164 4932 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539167 4932 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539170 4932 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539173 4932 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539177 4932 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539180 4932 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539183 4932 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539186 4932 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539189 4932 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539191 4932 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539194 4932 flags.go:64] FLAG: --system-cgroups="" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539197 4932 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539202 4932 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539205 4932 flags.go:64] FLAG: --tls-cert-file="" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539208 4932 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539238 4932 flags.go:64] FLAG: --tls-min-version="" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539241 4932 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539244 4932 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 05:49:11.550571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539247 4932 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539250 4932 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539254 4932 flags.go:64] FLAG: --v="2" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539258 4932 flags.go:64] FLAG: --version="false" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539264 4932 flags.go:64] FLAG: --vmodule="" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539268 4932 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539271 4932 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539453 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539463 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539466 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539468 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539471 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539476 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539478 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539481 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539483 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539486 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539489 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539491 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539494 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539496 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.551658 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539499 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539502 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539504 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539507 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539510 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539513 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539515 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539518 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539521 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539523 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539526 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539529 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539531 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539534 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539537 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539540 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539543 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539545 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539548 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539550 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.552433 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539559 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539562 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539565 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539568 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539571 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539574 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539576 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539579 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539581 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539584 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539587 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539589 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539592 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539594 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539597 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539600 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539602 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539605 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539607 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.553092 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539610 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539613 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539615 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539618 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539620 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539623 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539625 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539628 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539632 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539634 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539637 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539640 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539642 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539645 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539653 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539656 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539660 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539663 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539665 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.553807 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539668 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539671 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539674 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539678 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539681 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539685 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539688 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539690 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539693 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539696 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539698 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539701 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539703 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539706 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539710 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539713 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539716 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539719 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539721 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.554297 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539740 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539744 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539750 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539754 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539758 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539762 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539766 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539769 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539771 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539780 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539785 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539788 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539791 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539793 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539796 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.539824 4932 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:49:11.554790 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539872 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539877 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539880 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539884 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539887 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539890 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539893 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539896 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539899 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539902 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539904 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539907 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539909 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539912 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539915 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539917 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539920 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539922 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539927 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.555198 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539930 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539933 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539935 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539938 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539940 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539943 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539946 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539958 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539963 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539966 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539968 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539971 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539973 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539976 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539978 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539981 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539984 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539986 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539989 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539991 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.555788 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539994 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539997 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.539999 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540002 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540004 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540007 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540010 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540012 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540015 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540017 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540020 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540024 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540027 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540029 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540032 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540035 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540038 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540041 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540044 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.556472 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540046 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540052 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540055 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540058 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540060 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540063 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540066 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540068 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540071 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540074 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540076 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540079 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540081 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540084 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540087 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540089 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540093 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540096 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540100 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.556969 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540102 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540105 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540108 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540111 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540113 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540118 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540120 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540124 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540126 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540131 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540134 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540137 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540140 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540142 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540146 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540150 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540152 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540155 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540157 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.557422 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540160 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540166 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540169 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540172 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540174 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540177 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540179 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540182 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540185 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.540187 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.545263 4932 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.545287 4932 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.545313 4932 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.545321 4932 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545408 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545417 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545422 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545427 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545431 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545436 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.557892 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545440 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545445 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545449 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545454 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545458 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545463 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545467 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545472 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545476 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545480 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545485 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545489 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545493 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545498 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545502 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545506 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545511 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545515 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545521 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545525 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.558379 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545530 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545536 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545540 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545545 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545549 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545553 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545558 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545562 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545567 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545571 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545576 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545583 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545589 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545593 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545598 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545602 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545606 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545611 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545615 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545620 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.559024 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545625 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545629 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545634 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545639 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545643 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545647 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545651 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545656 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545661 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545665 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545670 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545675 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545679 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545684 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545689 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545693 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545698 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545703 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545707 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545712 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.559653 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545716 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545720 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545747 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545752 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545757 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545761 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545765 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545770 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545774 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545779 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545783 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545787 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545791 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545797 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545802 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545806 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545810 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545815 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545820 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.560305 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545827 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545833 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545838 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545843 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545850 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545855 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545859 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545863 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545867 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545872 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545876 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545881 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545885 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545889 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545893 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545898 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545902 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545907 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545911 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.560941 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545915 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.545920 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.545961 4932 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546181 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546190 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546195 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546200 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546205 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546210 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546215 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546220 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546226 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546232 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546237 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546241 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.561483 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546246 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546249 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546254 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546258 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546262 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546266 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546270 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546274 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546278 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546282 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546287 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546291 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546295 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546299 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546304 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546308 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546313 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546317 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546321 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546326 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.561871 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546330 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546335 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546340 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546345 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546349 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546353 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546359 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546363 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546367 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546371 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546376 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546380 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546385 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546390 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546394 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546398 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546402 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546407 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546411 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546415 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.562343 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546420 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546424 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546428 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546433 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546437 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546442 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546446 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546450 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546454 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546458 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546463 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546467 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546472 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546476 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546480 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546485 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546489 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546493 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546498 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546503 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.562846 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546507 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546511 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546516 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546520 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546525 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546529 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546533 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546538 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546542 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546546 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546550 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546554 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546558 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546563 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546568 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546572 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546576 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546580 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546585 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546589 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.563335 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546593 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546597 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546601 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546606 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546612 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546616 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546621 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546625 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546629 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546635 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546641 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546645 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546652 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546656 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.546693 4932 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:49:11.563831 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546760 4932 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546767 4932 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546772 4932 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546777 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546781 4932 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546785 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546790 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546794 4932 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546799 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546803 4932 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546808 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546812 4932 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546816 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546820 4932 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546825 4932 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546829 4932 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546833 4932 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546837 4932 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546841 4932 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546846 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:49:11.564194 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546850 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546855 4932 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546860 4932 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546864 4932 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546868 4932 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546873 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546877 4932 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546881 4932 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546885 4932 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546890 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546896 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546900 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546905 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546909 4932 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546913 4932 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546918 4932 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546922 4932 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546926 4932 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546930 4932 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546934 4932 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:49:11.564770 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546938 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546943 4932 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546950 4932 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546955 4932 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546959 4932 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546963 4932 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546968 4932 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546972 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546976 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546981 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546987 4932 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546991 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.546995 4932 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547000 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547004 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547008 4932 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547014 4932 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547021 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547026 4932 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:49:11.565281 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547030 4932 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547035 4932 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547039 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547044 4932 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547049 4932 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547053 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547057 4932 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547068 4932 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547073 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547077 4932 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547084 4932 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547091 4932 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547096 4932 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547100 4932 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547105 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547110 4932 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547115 4932 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547119 4932 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547124 4932 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:49:11.565749 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547128 4932 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547132 4932 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547137 4932 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547141 4932 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547145 4932 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547150 4932 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547153 4932 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547158 4932 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547162 4932 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547167 4932 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547171 4932 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547175 4932 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547179 4932 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547186 4932 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547190 4932 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547194 4932 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547198 4932 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547203 4932 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547208 4932 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547212 4932 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:49:11.566217 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547216 4932 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547221 4932 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547225 4932 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547229 4932 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547233 4932 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547237 4932 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547241 4932 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:11.547246 4932 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.547329 4932 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.548935 4932 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.549011 4932 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.549282 4932 server.go:1014] "Starting client certificate rotation" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.549420 4932 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.549469 4932 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:31 +0000 UTC" deadline="2028-06-17 23:44:48.353446731 +0000 UTC" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.549496 4932 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14201h55m36.803952779s" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.550017 4932 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:49:11.566744 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.551737 4932 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:49:11.567189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.553328 4932 log.go:25] "Validated CRI v1 runtime API" Nov 04 05:49:11.567189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.555140 4932 log.go:25] "Validated CRI v1 image API" Nov 04 05:49:11.567189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.555916 4932 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 05:49:11.567189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.557997 4932 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a3c6f9e5-607c-4146-8666-4bf4a3771c4b:/dev/nvme0n1p3 a5edb6b9-2509-40d2-bf34-0c0e8e17e43b:/dev/nvme0n1p4] Nov 04 05:49:11.567395 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.558018 4932 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/12fbe36526d09cc87f0c8fef7b1358fd2fb0530a9602c42cc1bc66cda0ebd20a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/12fbe36526d09cc87f0c8fef7b1358fd2fb0530a9602c42cc1bc66cda0ebd20a/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb/userdata/shm major:0 minor:227 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4adb3c6427520e45088079d229b50850106090f283e2eabb2d32c3f59b072abc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4adb3c6427520e45088079d229b50850106090f283e2eabb2d32c3f59b072abc/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/814d2a602def87aba2e51a2d0ad055b2e38d6a69b7290cc0f72efde51b2912df/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/814d2a602def87aba2e51a2d0ad055b2e38d6a69b7290cc0f72efde51b2912df/userdata/shm major:0 minor:221 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06220383-5a68-47d0-82ec-240a4f52379d/volumes/kubernetes.io~projected/kube-api-access-lr65f:{mountpoint:/var/lib/kubelet/pods/06220383-5a68-47d0-82ec-240a4f52379d/volumes/kubernetes.io~projected/kube-api-access-lr65f major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~projected/kube-api-access-tdfmq:{mountpoint:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~projected/kube-api-access-tdfmq major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/default-certificate major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/stats-auth major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~projected/kube-api-access-8bjsj:{mountpoint:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~projected/kube-api-access-8bjsj major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/207d14c9-591c-48e1-83a0-4ef555a1060c/volumes/kubernetes.io~projected/kube-api-access-lmqb4:{mountpoint:/var/lib/kubelet/pods/207d14c9-591c-48e1-83a0-4ef555a1060c/volumes/kubernetes.io~projected/kube-api-access-lmqb4 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27e10948-a9fa-4c51-bf42-20737f98c93b/volumes/kubernetes.io~projected/kube-api-access-kfw7q:{mountpoint:/var/lib/kubelet/pods/27e10948-a9fa-4c51-bf42-20737f98c93b/volumes/kubernetes.io~projected/kube-api-access-kfw7q major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2fc656f1-a57e-4676-a1e7-12d09a6186c7/volumes/kubernetes.io~projected/kube-api-access-mg68w:{mountpoint:/var/lib/kubelet/pods/2fc656f1-a57e-4676-a1e7-12d09a6186c7/volumes/kubernetes.io~projected/kube-api-access-mg68w major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/347a5e41-f3cc-42fe-8aef-1b54bec4d15d/volumes/kubernetes.io~projected/kube-api-access-85927:{mountpoint:/var/lib/kubelet/pods/347a5e41-f3cc-42fe-8aef-1b54bec4d15d/volumes/kubernetes.io~projected/kube-api-access-85927 major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ab95ff4-c0b4-4739-8727-3cae87d8b87b/volumes/kubernetes.io~projected/kube-api-access-gsxht:{mountpoint:/var/lib/kubelet/pods/3ab95ff4-c0b4-4739-8727-3cae87d8b87b/volumes/kubernetes.io~projected/kube-api-access-gsxht major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/476606ea-919f-4515-9203-8b2037dc7c51/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/476606ea-919f-4515-9203-8b2037dc7c51/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/528189d9-79b8-4ab9-82b0-88108f123fbd/volumes/kubernetes.io~projected/kube-api-access-vj9bs:{mountpoint:/var/lib/kubelet/pods/528189d9-79b8-4ab9-82b0-88108f123fbd/volumes/kubernetes.io~projected/kube-api-access-vj9bs major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/65672e16-9e00-4ac7-85fa-5bcfe335cf5e/volumes/kubernetes.io~projected/kube-api-access-v2xb2:{mountpoint:/var/lib/kubelet/pods/65672e16-9e00-4ac7-85fa-5bcfe335cf5e/volumes/kubernetes.io~projected/kube-api-access-v2xb2 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~projected/kube-api-access-rsrr2:{mountpoint:/var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~projected/kube-api-access-rsrr2 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a037747-8bc9-4521-bf55-cc2bfabbf819/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7a037747-8bc9-4521-bf55-cc2bfabbf819/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ab49653-7792-4182-afba-ed10eed2d1a1/volumes/kubernetes.io~projected/kube-api-access-z5rjs:{mountpoint:/var/lib/kubelet/pods/7ab49653-7792-4182-afba-ed10eed2d1a1/volumes/kubernetes.io~projected/kube-api-access-z5rjs major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/kube-api-access-jl94j:{mountpoint:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/kube-api-access-jl94j major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/95de3b39-ddde-46a0-aef0-47358e3b8c5a/volumes/kubernetes.io~projected/kube-api-access-jfcww:{mountpoint:/var/lib/kubelet/pods/95de3b39-ddde-46a0-aef0-47358e3b8c5a/volumes/kubernetes.io~projected/kube-api-access-jfcww major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~projected/kube-api-access-8ch52:{mountpoint:/var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~projected/kube-api-access-8ch52 major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab950d8a-b6ef-497c-8521-63af4c6f6fda/volumes/kubernetes.io~projected/kube-api-access-zvb64:{mountpoint:/var/lib/kubelet/pods/ab950d8a-b6ef-497c-8521-63af4c6f6fda/volumes/kubernetes.io~projected/kube-api-access-zvb64 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b31ca851-da8f-4b48-a061-360c4ba572ad/volumes/kubernetes.io~projected/kube-api-access-mlk98:{mountpoint:/var/lib/kubelet/pods/b31ca851-da8f-4b48-a061-360c4ba572ad/volumes/kubernetes.io~projected/kube-api-access-mlk98 major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b64f4769-591b-4958-8c40-1fc53f719b6e/volumes/kubernetes.io~projected/kube-api-access-sdd8l:{mountpoint:/var/lib/kubelet/pods/b64f4769-591b-4958-8c40-1fc53f719b6e/volumes/kubernetes.io~projected/kube-api-access-sdd8l major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~projected/kube-api-access-lkht4:{mountpoint:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~projected/kube-api-access-lkht4 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/kube-api-access-7d46m:{mountpoint:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/kube-api-access-7d46m major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~projected/kube-api-access-7wsx8:{mountpoint:/var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~projected/kube-api-access-7wsx8 major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c71ff75b-812f-45b8-9d99-58324eea7954/volumes/kubernetes.io~projected/kube-api-access-wnq75:{mountpoint:/var/lib/kubelet/pods/c71ff75b-812f-45b8-9d99-58324eea7954/volumes/kubernetes.io~projected/kube-api-access-wnq75 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc7055f3-cf05-4ec4-b101-3dbb34889de5/volumes/kubernetes.io~projected/kube-api-access-8pbdc:{mountpoint:/var/lib/kubelet/pods/cc7055f3-cf05-4ec4-b101-3dbb34889de5/volumes/kubernetes.io~projected/kube-api-access-8pbdc major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df28b9cd-719d-49aa-b00b-a23661cd2358/volumes/kubernetes.io~projected/kube-api-access-jbwp7:{mountpoint:/var/lib/kubelet/pods/df28b9cd-719d-49aa-b00b-a23661cd2358/volumes/kubernetes.io~projected/kube-api-access-jbwp7 major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~projected/kube-api-access-fgtmj:{mountpoint:/var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~projected/kube-api-access-fgtmj major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~secret/serving-cert major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~projected/kube-api-access-629bn:{mountpoint:/var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~projected/kube-api-access-629bn major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~secret/cert major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f787e527-00b4-405e-8c51-3df6dea1f644/volumes/kubernetes.io~projected/kube-api-access-nm2rq:{mountpoint:/var/lib/kubelet/pods/f787e527-00b4-405e-8c51-3df6dea1f644/volumes/kubernetes.io~projected/kube-api-access-nm2rq major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8fa3018-a250-4075-a258-3a8061e11466/volumes/kubernetes.io~projected/kube-api-access-p4p8v:{mountpoint:/var/lib/kubelet/pods/f8fa3018-a250-4075-a258-3a8061e11466/volumes/kubernetes.io~projected/kube-api-access-p4p8v major:0 minor:59 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/baca6c849a04f468e74c2aacdcb96ba35ef324f6018e86e734bb2e44a3e997f0/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/43835827b9c7279e6d246ae79fdc0d38c0eb3ef774ddc7027f91cbecaaf843ec/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/3383e5a9ad206c37084a9af246c186a37d2f1bc832d181a7cc48a85832d3fad6/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/0e540f8f87884f29932e5b79addfeda2291492343aa85cda60044b95c2d527bf/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/18815ff9fd868bf81cd4e40b9308b4268c3da3d5a1666f1f844c09d511305b70/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/9c85ef3748bf150d64c930df55c9e62458d694564a56a29dc6ebad05afc90c6a/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/df0fbad52b37c291050299883cbf8b95f1c4e3d2854e1218dd2158f634ce0810/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/d9e0b982b6660121f13e804392d904254603e8d684efff3d2ac66e7fa3c32ca3/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/f9b54e232c0a723382b8936e92c3f80f0c974bbc43563883573639f2c2c14a3d/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-131:{mountpoint:/var/lib/containers/storage/overlay/2f6c0bea91219c74d3b8404f47ea52fc28a5608f6c60b02a2ac0c42ea3673d5c/merged major:0 minor:131 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2148e10c18de492a959879b16651c8f2dc3e0cddcc1a2516e73b651f7e7afa7b/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/4d9d64d86a0b58b572ac3549ab91b782e209de2bb3b3fa2d4b2b228910d53191/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/c144e435656bb97ddf956ee3509ce9eaa7ff8c03206d60a95647f9dcac79076f/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/46957c41a28cc600e114514582ca7acf9dd476b12fd4e86594d18e13530eca0a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/26bb7f9558bfc90faa681f1883f1007028933f25370976ca247e649c9c480b3c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/a6339f6c19732c06cbc0549112be4d4173a2390b4a7e332051137e299ea4e8e8/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/64176b58da40095ddfd3534020a5911a76db569039093bd2188ed3d99978dd9e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/537902a5b153b953962017110723e633c0246be493aabcc2297450aaa225283f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/8829fbe888492b1a7b24bb53f427c06d738c1200328a80eced2bd073db7c696c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/01ac6ef109e0dd321e43b674a43d6043a067eab69cdd378412a6c9cbcf79ab25/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/cc2ad4a7b1092c6dc629fc756794c7cf47ed5ff8b4e0b91c25438657653b8130/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/13d131f9cf02af6ca9848dc398bb96347e494382f7239cc74831bf06893c8e9e/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/37bd5d1244c24e6295d3cb3aea0dfc57e982d7bea55ed1bb1c760a50a102ef70/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/a9539dc3583c901abd466217ae067435ebc4482da8af0acc6549c556f57d9af2/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/1b5d45b07f5325fa78912548c479e8758455836ffbf999707e20272c31ca0f1b/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/b7196381f28f3ad3cdb581bbab451c20483c3e6db40868b8cfeddcc1ee265349/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/65052ca9a9529d65f60b648debe2846def7ebedb9c76a9fbf6fe79a1f0892bda/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/477cc9e6ed8868c1ce2b19d22de73219274d25e55febc1615533a2200b0efb21/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/c339a33ba43da389572afa4c03088ff833db64e7a649e8ed9e532ca0a97bf082/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/54a34987f1dc4e704f038896f9f8951a0ed3c6d844d8905c078ff35e29aca94a/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/f37b955ecf2a198f5e9810c256a86d0d290b319760b3978806be1189382278d1/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/29c5cbc3ddbc2f177099f22c13278dd34b3a3fcc7ab6f2b18997156ea545e758/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/85436ad3219b305559353511a50ee6a1c1793986804c57d09e00ba958c927ba3/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/8cf29ac31421ae013e8cedf326b29f09a631322d5b9db39a26f49b89f9bafe34/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/ddda2a782e25389079dab769bdb03f65137164e4d91b3e7f5d37c8fa0bdbe85a/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/235b7ce07a4c4a8386d610021733d1077c8c8e2b33575bdabf137632942c6e53/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/5b9a72936873f34fff1aabaa089a3264f776ee379248f3dba32167078fdbf0c4/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/27f76fc49daf5b5fb07ec78a3a187ff35b02f6cac4a72f3184a5021039a60daa/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/706aee912ee512add241cb621dd8e0e85b55371e6080b35ff27b98cd1d99b817/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/caa34bdfd1dfe7f95912cf4cc65d83373e2e969af771d9cd75d0492bb22c2af5/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/068ae7e0de53f9772ee641e1bc0018f414792db191b7dff23e4644a5e9b2f03b/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/3b0707b6ba3e7a331114c6d820787e221873106466fe3b72c2cfd7bfd253b457/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/645d480e75c37621b2f9dd7ddff3042eb48d3ecab8a8bb97edd50ec1b7c874e2/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/aebf243904fce44a7e1805b8a8e9a2aa41302ede330ae08f8f97acc11dc7fafa/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/8c2bc1bd5059009ab29006319d72deb3a9444fa4c00d4c252897f73ed3e27b7a/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/8a15ee11dc7aeeb8d0a9b6a75d99417847538bbc0958081cd5fd585d5f558f85/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/102aa1e5f6fa96f38ce8402e62aa85da4559a902a1207e02c002b99a137cb4d0/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/0f56c9d46ba21bc1dc3fb0db74cda9228a9d6a65b7bac10849802d00a7be35e3/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7a139e021908db2e4eeda6a5e758129dbf72b4e531d71fc45dc40a8ae9e384d7/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/799b85bb5a30172d24bfab7eaab7b6887b35223289534af6d41dfd7aab7c0d78/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-77:{mountpoint:/var/lib/containers/storage/overlay/cf3c0b3ecee6258bcf9e5d8732d6d111f13353758fc4828fbcb135cb0c289237/merged major:0 minor:77 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/83a5e88027c24d02915a093ce08d18fd498bd81c1cf5b71aac83c402721bf3f2/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/cd376ee0a35baf19df32f137420979272998fa3e5f290efbc89fd33fb9f400b5/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/04c8ff4bed81e6bb815eb4969002c65f389ea734e65fd4f2de0cd49685399a44/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/adccbc6ee987ed807a13cec8c43890d8cc2b94def1c8be0037701d4736cf4c28/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/3e907a32700ec39f589d0068f4029cbf9db16e1fbb795bd9d5b7e4c91eda8146/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 05:49:11.568956 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.567245 4932 manager.go:217] Machine: {Timestamp:2026-11-04 05:49:11.56668484 +0000 UTC m=+0.064079596 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100515 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2908a5aa4e99a0c670f289c341fd16 SystemUUID:ec2908a5-aa4e-99a0-c670-f289c341fd16 BootID:f0d84363-bf6f-4760-a50c-60f6d17d51cd Filesystems:[{Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a96a990300309ed5c35c953e61c18fa0adbc864f846bb721a9b1837900ae2b46/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/kube-api-access-7d46m DeviceMajor:0 DeviceMinor:237 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~projected/kube-api-access-fgtmj DeviceMajor:0 DeviceMinor:241 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5dff7bccf92f60e05bd5248f4bfdb3df37869b7ae781718859dc510cc6201868/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c71ff75b-812f-45b8-9d99-58324eea7954/volumes/kubernetes.io~projected/kube-api-access-wnq75 DeviceMajor:0 DeviceMinor:211 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:216 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:217 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ef5b6be50bd7c79af532734400c0692f6f66f817b947345eba7a3bd4ecd4bff9/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f8fa3018-a250-4075-a258-3a8061e11466/volumes/kubernetes.io~projected/kube-api-access-p4p8v DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d75d755a61becf03f9cf36447a93e7fb4fa7b57c253f78b9edaeb0e33ec5a0a/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06220383-5a68-47d0-82ec-240a4f52379d/volumes/kubernetes.io~projected/kube-api-access-lr65f DeviceMajor:0 DeviceMinor:238 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:48 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-131 DeviceMajor:0 DeviceMinor:131 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3ab95ff4-c0b4-4739-8727-3cae87d8b87b/volumes/kubernetes.io~projected/kube-api-access-gsxht DeviceMajor:0 DeviceMinor:207 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7ab49653-7792-4182-afba-ed10eed2d1a1/volumes/kubernetes.io~projected/kube-api-access-z5rjs DeviceMajor:0 DeviceMinor:209 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~projected/kube-api-access-8bjsj DeviceMajor:0 DeviceMinor:53 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3aebf111e5d4352ee1095515a87a25e84e7207e629008b265121f3548685a8bb/userdata/shm DeviceMajor:0 DeviceMinor:227 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc7055f3-cf05-4ec4-b101-3dbb34889de5/volumes/kubernetes.io~projected/kube-api-access-8pbdc DeviceMajor:0 DeviceMinor:333 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/347a5e41-f3cc-42fe-8aef-1b54bec4d15d/volumes/kubernetes.io~projected/kube-api-access-85927 DeviceMajor:0 DeviceMinor:52 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d7d31c3ecc6e16d3e19727fa1466514be4b1407ab64fab28777a9e728201714/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b31ca851-da8f-4b48-a061-360c4ba572ad/volumes/kubernetes.io~projected/kube-api-access-mlk98 DeviceMajor:0 DeviceMinor:328 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7a037747-8bc9-4521-bf55-cc2bfabbf819/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/65672e16-9e00-4ac7-85fa-5bcfe335cf5e/volumes/kubernetes.io~projected/kube-api-access-v2xb2 DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/27e10948-a9fa-4c51-bf42-20737f98c93b/volumes/kubernetes.io~projected/kube-api-access-kfw7q DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:214 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/476606ea-919f-4515-9203-8b2037dc7c51/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:286 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:232 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/b7204797-c3d2-45b2-b664-d7719428b23a/volumes/kubernetes.io~projected/kube-api-access-lkht4 DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/714fc0ae-5c6c-4738-8bea-54bf573f85ff/volumes/kubernetes.io~projected/kube-api-access-rsrr2 DeviceMajor:0 DeviceMinor:210 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ff160cc844efb5f8e147a0597fdd0230d0a211fbf1d0875a3b150e16f0daef6/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/207d14c9-591c-48e1-83a0-4ef555a1060c/volumes/kubernetes.io~projected/kube-api-access-lmqb4 DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/95de3b39-ddde-46a0-aef0-47358e3b8c5a/volumes/kubernetes.io~projected/kube-api-access-jfcww DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/12fbe36526d09cc87f0c8fef7b1358fd2fb0530a9602c42cc1bc66cda0ebd20a/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4adb3c6427520e45088079d229b50850106090f283e2eabb2d32c3f59b072abc/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-77 DeviceMajor:0 DeviceMinor:77 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~projected/kube-api-access-8ch52 DeviceMajor:0 DeviceMinor:205 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:231 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~projected/kube-api-access-jl94j DeviceMajor:0 DeviceMinor:233 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/df28b9cd-719d-49aa-b00b-a23661cd2358/volumes/kubernetes.io~projected/kube-api-access-jbwp7 DeviceMajor:0 DeviceMinor:235 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:215 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7dd30e4dd9ca75679be607283d06f2a6f896b12f88032f69030941f5ff98c211/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ab950d8a-b6ef-497c-8521-63af4c6f6fda/volumes/kubernetes.io~projected/kube-api-access-zvb64 DeviceMajor:0 DeviceMinor:234 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bea5e9075c62f6ae70a3d43edf8a97e82b55e3a442368165d4db92dfab6d8645/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/174af9e853b932e33636cdad59f1726fc62b9e83bc20e3d661032e48f662bf41/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d3250c-1086-420a-8645-e9eb443bf85f/volumes/kubernetes.io~projected/kube-api-access-629bn DeviceMajor:0 DeviceMinor:236 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/181965dd8eb9f4155bda77f1b706fabe73581f5ae98ebc91124f81883d537442/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b878a5ad0c481f999eea27f8d8e355e2802163ff9beecea4f01e32aee8425d4a/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/136c23f47e9327c674c1791251a50d49228f9b296e89be69ea58db4112d13b2e/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78ea99086995f0b46dda5ee3c1a84e551def8ebed3ae240cc1b8fdf359148e93/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c15ff564e9d71488c02062891323b00cc34384e4d50539a6e3eca8c26f7f199/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b42aac288d7ccc3267299b4e30cf61ad28f397e810ba8e674325b8e67f4fe43/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a80c35a91966ea773ae1902a5267cf8297a0e02506beb04ed61c95af451623f/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2fc656f1-a57e-4676-a1e7-12d09a6186c7/volumes/kubernetes.io~projected/kube-api-access-mg68w DeviceMajor:0 DeviceMinor:51 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1074f5dc-50ec-4134-b826-aa6be14d2e1f/volumes/kubernetes.io~projected/kube-api-access-tdfmq DeviceMajor:0 DeviceMinor:206 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/528189d9-79b8-4ab9-82b0-88108f123fbd/volumes/kubernetes.io~projected/kube-api-access-vj9bs DeviceMajor:0 DeviceMinor:208 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/814d2a602def87aba2e51a2d0ad055b2e38d6a69b7290cc0f72efde51b2912df/userdata/shm DeviceMajor:0 DeviceMinor:221 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b64f4769-591b-4958-8c40-1fc53f719b6e/volumes/kubernetes.io~projected/kube-api-access-sdd8l DeviceMajor:0 DeviceMinor:54 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/be228dc0-014f-43a6-99c9-dfc7cdd45b37/volumes/kubernetes.io~projected/kube-api-access-7wsx8 DeviceMajor:0 DeviceMinor:212 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f0b905f9-e91d-4a54-b373-460596807036/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:213 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a984a632-aac0-4b55-8e45-5da4ff687d91/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:218 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5354b5227b9f3b445ccf7c62215d621287adb0f85d21d0eacc31946534d57c4c/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f787e527-00b4-405e-8c51-3df6dea1f644/volumes/kubernetes.io~projected/kube-api-access-nm2rq DeviceMajor:0 DeviceMinor:287 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/149702ab-12dd-47a1-80b5-efbe1efad1af/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:12fbe36526d09cc MacAddress:aa:99:56:ac:9f:95 Speed:10000 Mtu:8901} {Name:1d75d755a61becf MacAddress:0e:d3:c9:6f:ff:fb Speed:10000 Mtu:8901} {Name:1ff160cc844efb5 MacAddress:6a:2d:df:7c:32:29 Speed:10000 Mtu:8901} {Name:3aebf111e5d4352 MacAddress:5e:10:9b:4a:f3:8c Speed:10000 Mtu:8901} {Name:4adb3c6427520e4 MacAddress:de:fd:ca:4f:2f:db Speed:10000 Mtu:8901} {Name:5354b5227b9f3b4 MacAddress:3e:c7:59:89:06:6f Speed:10000 Mtu:8901} {Name:6a80c35a91966ea MacAddress:6e:e0:b4:24:7b:a7 Speed:10000 Mtu:8901} {Name:7b42aac288d7ccc MacAddress:ea:3c:c1:e8:3d:65 Speed:10000 Mtu:8901} {Name:7dd30e4dd9ca756 MacAddress:62:e7:29:b3:6c:99 Speed:10000 Mtu:8901} {Name:814d2a602def87a MacAddress:7e:e0:01:ea:7c:4f Speed:10000 Mtu:8901} {Name:a96a990300309ed MacAddress:ea:d6:48:22:b6:12 Speed:10000 Mtu:8901} {Name:b878a5ad0c481f9 MacAddress:b2:59:85:f1:8e:a9 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:31:a4:02:04:91 Speed:0 Mtu:9001} {Name:br-int MacAddress:ce:42:b9:40:3c:21 Speed:0 Mtu:8901} {Name:ef5b6be50bd7c79 MacAddress:da:45:b4:a1:8a:ca Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:31:a4:02:04:91 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:72:0e:36:f1:c8:37 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:6a:7b:24:04:53:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 05:49:11.569229 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.568962 4932 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 05:49:11.569229 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569024 4932 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 05:49:11.569310 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569282 4932 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 05:49:11.569437 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569312 4932 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-0.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 05:49:11.569484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569439 4932 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 05:49:11.569484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569447 4932 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 05:49:11.569484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569457 4932 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:49:11.569484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569478 4932 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:49:11.569592 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569562 4932 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 05:49:11.569710 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569701 4932 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 05:49:11.569836 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569826 4932 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 05:49:11.569874 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569862 4932 kubelet.go:493] "Attempting to sync node with API server" Nov 04 05:49:11.569904 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569876 4932 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 05:49:11.569904 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569886 4932 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 05:49:11.569904 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569895 4932 kubelet.go:405] "Adding apiserver pod source" Nov 04 05:49:11.569904 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.569904 4932 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 05:49:11.570532 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.570517 4932 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 05:49:11.570532 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.570529 4932 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:49:11.571000 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.570981 4932 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 05:49:11.573376 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573360 4932 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 05:49:11.573376 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573373 4932 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:49:11.573472 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573463 4932 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 05:49:11.573648 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573637 4932 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 05:49:11.573683 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573666 4932 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 05:49:11.573795 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573785 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573801 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573807 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573813 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573818 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573824 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573830 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 05:49:11.573835 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573836 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573843 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573849 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573863 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573872 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573899 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 05:49:11.574098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.573904 4932 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 05:49:11.577292 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.577278 4932 server.go:1263] "Started kubelet" Nov 04 05:49:11.577368 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.577342 4932 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 05:49:11.578436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.577432 4932 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 05:49:11.578436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.577519 4932 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 05:49:11.578436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.578293 4932 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 05:49:11.577901 ip-10-0-133-0 systemd[1]: Started Kubernetes Kubelet. Nov 04 05:49:11.579422 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.579403 4932 server.go:317] "Adding debug handlers to kubelet server" Nov 04 05:49:11.581326 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.581020 4932 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 05:49:11.581326 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.581219 4932 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 05:49:11.581499 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.581484 4932 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 05:49:11.581579 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.581500 4932 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 05:49:11.581828 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.581790 4932 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.582038 4932 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.582570 4932 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:32 +0000 UTC" deadline="2028-05-27 09:18:28.726735767 +0000 UTC" Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.582643 4932 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13683h29m17.144098121s" Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.583227 4932 factory.go:55] Registering systemd factory Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.583245 4932 factory.go:223] Registration of the systemd container factory successfully Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584064 4932 factory.go:153] Registering CRI-O factory Nov 04 05:49:11.584098 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584083 4932 factory.go:223] Registration of the crio container factory successfully Nov 04 05:49:11.584484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584147 4932 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 05:49:11.584484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584169 4932 factory.go:103] Registering Raw factory Nov 04 05:49:11.584484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584186 4932 manager.go:1199] Started watching for new ooms in manager Nov 04 05:49:11.584627 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.584597 4932 manager.go:319] Starting recovery of all containers Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.588967 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7204797-c3d2-45b2-b664-d7719428b23a" volumeName="kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589030 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589046 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df28b9cd-719d-49aa-b00b-a23661cd2358" volumeName="kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589060 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea482e24-86b9-4576-9259-fe6adc58a9c3" volumeName="kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589075 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f787e527-00b4-405e-8c51-3df6dea1f644" volumeName="kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589088 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589098 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06220383-5a68-47d0-82ec-240a4f52379d" volumeName="kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589110 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="65672e16-9e00-4ac7-85fa-5bcfe335cf5e" volumeName="kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589124 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7204797-c3d2-45b2-b664-d7719428b23a" volumeName="kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589148 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589162 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d3250c-1086-420a-8645-e9eb443bf85f" volumeName="kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589175 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="149702ab-12dd-47a1-80b5-efbe1efad1af" volumeName="kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589188 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="528189d9-79b8-4ab9-82b0-88108f123fbd" volumeName="kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589204 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a037747-8bc9-4521-bf55-cc2bfabbf819" volumeName="kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589220 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589233 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a984a632-aac0-4b55-8e45-5da4ff687d91" volumeName="kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589250 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be228dc0-014f-43a6-99c9-dfc7cdd45b37" volumeName="kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589263 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="347a5e41-f3cc-42fe-8aef-1b54bec4d15d" volumeName="kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589276 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589289 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be228dc0-014f-43a6-99c9-dfc7cdd45b37" volumeName="kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589302 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8fa3018-a250-4075-a258-3a8061e11466" volumeName="kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589315 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589330 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06220383-5a68-47d0-82ec-240a4f52379d" volumeName="kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589343 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2fc656f1-a57e-4676-a1e7-12d09a6186c7" volumeName="kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589357 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ab95ff4-c0b4-4739-8727-3cae87d8b87b" volumeName="kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589389 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589402 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="95de3b39-ddde-46a0-aef0-47358e3b8c5a" volumeName="kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589416 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c71ff75b-812f-45b8-9d99-58324eea7954" volumeName="kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589435 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589446 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2fc656f1-a57e-4676-a1e7-12d09a6186c7" volumeName="kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589474 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a037747-8bc9-4521-bf55-cc2bfabbf819" volumeName="kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589486 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589498 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b64f4769-591b-4958-8c40-1fc53f719b6e" volumeName="kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589509 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7204797-c3d2-45b2-b664-d7719428b23a" volumeName="kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589522 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be228dc0-014f-43a6-99c9-dfc7cdd45b37" volumeName="kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589534 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589546 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df28b9cd-719d-49aa-b00b-a23661cd2358" volumeName="kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589557 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589569 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8fa3018-a250-4075-a258-3a8061e11466" volumeName="kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589580 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e10948-a9fa-4c51-bf42-20737f98c93b" volumeName="kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589593 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab950d8a-b6ef-497c-8521-63af4c6f6fda" volumeName="kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589604 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b31ca851-da8f-4b48-a061-360c4ba572ad" volumeName="kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589615 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589627 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589642 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc7055f3-cf05-4ec4-b101-3dbb34889de5" volumeName="kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589653 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589666 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1074f5dc-50ec-4134-b826-aa6be14d2e1f" volumeName="kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589678 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ab49653-7792-4182-afba-ed10eed2d1a1" volumeName="kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589689 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a984a632-aac0-4b55-8e45-5da4ff687d91" volumeName="kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589701 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b31ca851-da8f-4b48-a061-360c4ba572ad" volumeName="kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589712 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589739 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d3250c-1086-420a-8645-e9eb443bf85f" volumeName="kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589752 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8fa3018-a250-4075-a258-3a8061e11466" volumeName="kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589765 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1074f5dc-50ec-4134-b826-aa6be14d2e1f" volumeName="kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589776 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="714fc0ae-5c6c-4738-8bea-54bf573f85ff" volumeName="kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589788 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="714fc0ae-5c6c-4738-8bea-54bf573f85ff" volumeName="kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589808 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a984a632-aac0-4b55-8e45-5da4ff687d91" volumeName="kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589820 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589833 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b64f4769-591b-4958-8c40-1fc53f719b6e" volumeName="kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589846 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589859 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207d14c9-591c-48e1-83a0-4ef555a1060c" volumeName="kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589870 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" volumeName="kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589882 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7204797-c3d2-45b2-b664-d7719428b23a" volumeName="kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589895 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207d14c9-591c-48e1-83a0-4ef555a1060c" volumeName="kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589908 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e10948-a9fa-4c51-bf42-20737f98c93b" volumeName="kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589920 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" volumeName="kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589932 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df28b9cd-719d-49aa-b00b-a23661cd2358" volumeName="kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589944 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b905f9-e91d-4a54-b373-460596807036" volumeName="kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589955 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be228dc0-014f-43a6-99c9-dfc7cdd45b37" volumeName="kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589968 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="149702ab-12dd-47a1-80b5-efbe1efad1af" volumeName="kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589982 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7204797-c3d2-45b2-b664-d7719428b23a" volumeName="kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.589993 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207d14c9-591c-48e1-83a0-4ef555a1060c" volumeName="kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590006 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="476606ea-919f-4515-9203-8b2037dc7c51" volumeName="kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590018 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="714fc0ae-5c6c-4738-8bea-54bf573f85ff" volumeName="kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590030 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="95de3b39-ddde-46a0-aef0-47358e3b8c5a" volumeName="kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590041 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8fa3018-a250-4075-a258-3a8061e11466" volumeName="kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590056 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1074f5dc-50ec-4134-b826-aa6be14d2e1f" volumeName="kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590066 4932 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="149702ab-12dd-47a1-80b5-efbe1efad1af" volumeName="kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj" seLinuxMountContext="" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590078 4932 reconstruct.go:97] "Volume reconstruction finished" Nov 04 05:49:11.590757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.590085 4932 reconciler.go:29] "Reconciler: start to sync state" Nov 04 05:49:11.603990 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.603718 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:11.604484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.604447 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:11.608946 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.608897 4932 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 05:49:11.610401 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.610384 4932 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 05:49:11.610474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.610402 4932 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 05:49:11.610474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.610428 4932 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 05:49:11.610534 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.610472 4932 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 05:49:11.621483 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621440 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="efe2ea30a89e19f416c1f9ba46600c54cf3500ad54eb9e295bba5685cfead292" exitCode=0 Nov 04 05:49:11.621556 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621486 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="c60c5e34477880d34cc8d7ea4feed3d366711cab09fd5db6f6e5b50dcab5d4da" exitCode=0 Nov 04 05:49:11.621556 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621498 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="516e448f86765eb545041f6e5af192873ff68f3eef65b77a3e7ae28de0656e65" exitCode=0 Nov 04 05:49:11.621556 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621507 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="ff44bd78e0f05abf3fc4f39cdb6ace60a541ba856bde3be377b67db391fad91f" exitCode=0 Nov 04 05:49:11.621556 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621515 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="8ea1e1740fe96af74d65341deb4417a2f94b387c1024a6efbc3d8d9dc3cc8e6d" exitCode=0 Nov 04 05:49:11.621556 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.621523 4932 generic.go:356] "Generic (PLEG): container finished" podID="f8fa3018-a250-4075-a258-3a8061e11466" containerID="c6496880c655474cf28de81620582716e88fc93d5269a53cd06f352fbe35b61b" exitCode=0 Nov 04 05:49:11.656375 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.656348 4932 generic.go:356] "Generic (PLEG): container finished" podID="e6a153c0e32e7dc1a08e4a5a7277831c" containerID="5b97558eceb1f1d83b5fe473806a1e8a0a250d18b33575e372480e1cbf33e1f4" exitCode=0 Nov 04 05:49:11.661937 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.661917 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:11.662037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.661941 4932 generic.go:356] "Generic (PLEG): container finished" podID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" exitCode=255 Nov 04 05:49:11.676964 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.676945 4932 manager.go:324] Recovery completed Nov 04 05:49:11.681872 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.681851 4932 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:49:11.696196 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.696146 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.697389 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.697373 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.697456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.697404 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.697456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.697415 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.699504 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699483 4932 cpu_manager.go:226] "Starting" policy="none" Nov 04 05:49:11.699504 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699498 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.699607 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699499 4932 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 05:49:11.699607 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699599 4932 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 05:49:11.699752 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699709 4932 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 05:49:11.699800 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699740 4932 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 05:49:11.699832 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699809 4932 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 05:49:11.699832 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699815 4932 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 05:49:11.699832 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699822 4932 policy_none.go:50] "Start" Nov 04 05:49:11.699832 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699832 4932 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 05:49:11.699943 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699841 4932 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 05:49:11.699993 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699957 4932 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 05:49:11.699993 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699964 4932 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 05:49:11.699993 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.699969 4932 policy_none.go:44] "Start" Nov 04 05:49:11.700484 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.700469 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.700554 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.700500 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.700554 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.700516 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.704510 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.704479 4932 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 05:49:11.707135 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707122 4932 manager.go:341] "Starting Device Plugin manager" Nov 04 05:49:11.707206 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.707146 4932 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 05:49:11.707206 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707155 4932 server.go:87] "Starting device plugin registration server" Nov 04 05:49:11.707409 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707398 4932 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 05:49:11.707473 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707408 4932 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 05:49:11.707530 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707506 4932 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 05:49:11.707656 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707614 4932 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 05:49:11.707788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707663 4932 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 05:49:11.707788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707670 4932 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 05:49:11.707788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.707706 4932 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:49:11.707652144Z","UUID":"2c44c4e7-ad30-411c-92e1-d666c0e8a014","Handler":null,"Name":"","Endpoint":""} Nov 04 05:49:11.709023 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.708996 4932 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 05:49:11.709122 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.709035 4932 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" Nov 04 05:49:11.709122 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.709043 4932 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 05:49:11.709122 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.709077 4932 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 05:49:11.710558 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.710520 4932 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal"] Nov 04 05:49:11.710668 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.710651 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.712007 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.711989 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.712100 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.712019 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.712100 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.712036 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.712424 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.712396 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.712535 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.712515 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.713546 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713528 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.713628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713556 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.713628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713572 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.713628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713578 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.713628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713597 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.713628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713611 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.713845 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.713778 4932 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.714009 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.713971 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"f094e9921d2f7c68bdccfd2d0136c26f","Type":"ContainerStarted","Data":"bc0b9a56121d88c1558550f75b3bb055d40d5f160ab0a28431e2c0c1e7b4b56a"} Nov 04 05:49:11.714047 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.714022 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"f094e9921d2f7c68bdccfd2d0136c26f","Type":"ContainerStarted","Data":"4a7706949497b7dea69fc78f7ae56a205ea77c459fc2311de5a4b456db65cf6e"} Nov 04 05:49:11.714095 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.714051 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.714095 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.714082 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerStarted","Data":"3417b5e951588c662885fc939544e711bf629784baf0513f3ad0ae8c1aa0e4ff"} Nov 04 05:49:11.714192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.714101 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerDied","Data":"5b97558eceb1f1d83b5fe473806a1e8a0a250d18b33575e372480e1cbf33e1f4"} Nov 04 05:49:11.714192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.714118 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" event={"ID":"e6a153c0e32e7dc1a08e4a5a7277831c","Type":"ContainerStarted","Data":"71f97356e31f62d8098b378be5d38701e624108a5526401612b5c2da9daf60c0"} Nov 04 05:49:11.720429 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.720412 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.720503 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.720441 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.720503 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.720452 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.720574 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.720564 4932 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.us-west-1.compute.internal\" not found" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.798402 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.798365 4932 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:49:11.798402 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.798392 4932 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:49:11.798593 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.798424 4932 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 05:49:11.799322 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.799306 4932 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:49:11.808222 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.808204 4932 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:49:11.809396 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.809379 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:49:11.809463 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.809410 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:49:11.809463 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.809421 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:49:11.809532 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.809470 4932 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.854142 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.854117 4932 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:49:11.882553 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.882532 4932 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.898752 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.898714 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.898826 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.898800 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.898877 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.898845 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.926010 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.925988 4932 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.926079 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.926060 4932 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.926624 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.926609 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeNotReady" Nov 04 05:49:11.926662 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.926640 4932 setters.go:546] "Node became not ready" node="ip-10-0-133-0.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T05:49:11Z","lastTransitionTime":"2026-11-04T05:49:11Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 04 05:49:11.947712 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.947664 4932 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:49:11.947712 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:11.947706 4932 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.947844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.947721 4932 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.974443 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.974423 4932 nodeinfomanager.go:471] existing CSINode "ip-10-0-133-0.us-west-1.compute.internal" is owned by different node (oldNodeID="39ac1b9c-37ba-42d3-b01c-fc09c6366fe9", newNodeID=""), cleaning up... Nov 04 05:49:11.999559 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999540 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.999660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999564 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.999660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999582 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.999660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999620 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f094e9921d2f7c68bdccfd2d0136c26f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"f094e9921d2f7c68bdccfd2d0136c26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.999830 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999651 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:11.999830 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:11.999674 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a153c0e32e7dc1a08e4a5a7277831c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" (UID: \"e6a153c0e32e7dc1a08e4a5a7277831c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.050700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.050668 4932 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:49:12.050858 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.050742 4932 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.570109 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.570081 4932 apiserver.go:52] "Watching apiserver" Nov 04 05:49:12.665365 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.665334 4932 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.665509 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.665407 4932 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.734439 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.734414 4932 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:49:12.734439 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.734416 4932 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:49:12.734635 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.734481 4932 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.734635 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.734517 4932 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal" Nov 04 05:49:12.734945 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.734930 4932 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 05:49:12.735604 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.735569 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679","openshift-image-registry/image-registry-5696797f45-ck8gh","openshift-network-operator/iptables-alerter-tnkp7","kube-system/kas-connection-checker-685895c7c9-ktphf","openshift-console-operator/console-operator-7cd56b8dbc-2x2d7","kube-system/kas-connection-checker-685895c7c9-gkpc2","openshift-network-diagnostics/network-check-target-6vqw4","openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5","openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds","openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx","openshift-multus/multus-additional-cni-plugins-tq87s","openshift-ingress-canary/ingress-canary-qzjcp","openshift-multus/multus-nxlbs","kube-system/kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal","openshift-ingress/router-default-5c558747f-x6r92","kube-system/kas-connection-checker-685895c7c9-n7dfn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54","openshift-dns/dns-default-9g4nv","openshift-ovn-kubernetes/ovnkube-node-znv7k","openshift-insights/insights-runtime-extractor-pthc4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-rcfhb","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh","openshift-cluster-node-tuning-operator/tuned-gxgpb","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk","openshift-image-registry/node-ca-8rg9n","openshift-image-registry/image-registry-85dd4d4d8d-cpcjd","kube-system/global-pull-secret-syncer-xpsrx","openshift-dns/node-resolver-d6hqt","kube-system/konnectivity-agent-swhsx","openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4","openshift-insights/insights-operator-7c4986d449-6t5rr","openshift-network-console/networking-console-plugin-86c478bb88-9x87d"] Nov 04 05:49:12.736735 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.736712 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.738134 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.738116 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.741666 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.741633 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.741795 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.741716 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.742747 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.742709 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:12.748203 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.748188 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:12.750929 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.750912 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.751514 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.751496 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.753103 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.753085 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.784048 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.784025 4932 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 05:49:12.792662 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.792618 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.792662 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.792641 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.792825 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.792780 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 05:49:12.793025 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793009 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.793253 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793232 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.793305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793252 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.793305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793274 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.793305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793286 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.793305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793297 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 05:49:12.793490 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793389 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 05:49:12.793752 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793740 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 05:49:12.793817 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.793802 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 05:49:12.794167 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794151 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 05:49:12.794243 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794195 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.794332 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794319 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.794398 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794368 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.794450 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794403 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 05:49:12.794627 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794609 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.794720 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794630 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 05:49:12.794720 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794636 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 05:49:12.794867 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794673 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.794867 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794683 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.794867 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.794742 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 05:49:12.795434 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.795420 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 05:49:12.796865 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.796852 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.798117 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798102 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 05:49:12.798273 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798261 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 05:49:12.798351 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798334 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 05:49:12.798462 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798339 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 05:49:12.798462 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798382 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 05:49:12.798560 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798488 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.798606 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798587 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 05:49:12.798673 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798657 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.798737 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798659 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 05:49:12.798737 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798692 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 05:49:12.798737 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798707 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798719 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798711 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798761 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798703 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798709 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.798853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.798740 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.805128 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805112 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:49:12.805180 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805135 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.805180 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805152 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9bs\" (UniqueName: \"kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs\") pod \"kas-connection-checker-685895c7c9-n7dfn\" (UID: \"528189d9-79b8-4ab9-82b0-88108f123fbd\") " pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:12.805180 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805170 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.805297 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805185 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.805297 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805260 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvb64\" (UniqueName: \"kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64\") pod \"network-check-source-6f78d59f99-bhng4\" (UID: \"ab950d8a-b6ef-497c-8521-63af4c6f6fda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:12.805364 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805304 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.805364 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805329 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85927\" (UniqueName: \"kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:12.805364 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805346 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.805511 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805364 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.805511 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805417 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg68w\" (UniqueName: \"kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.805511 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805463 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.805511 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805494 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805531 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805561 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805576 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805590 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-snapshots\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805596 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wsx8\" (UniqueName: \"kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805501 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.805695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805688 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805771 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64f4769-591b-4958-8c40-1fc53f719b6e-serviceca\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805824 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be228dc0-014f-43a6-99c9-dfc7cdd45b37-serving-cert\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805869 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805879 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805924 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805940 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.806003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.805977 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806010 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806061 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlk98\" (UniqueName: \"kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806101 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwp7\" (UniqueName: \"kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806127 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806152 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806168 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806184 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806211 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806240 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:12.806312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806273 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806323 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806350 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806394 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdd8l\" (UniqueName: \"kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806419 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806443 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806459 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806488 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806540 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806550 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b31ca851-da8f-4b48-a061-360c4ba572ad-data-volume\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806623 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.806700 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806625 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df28b9cd-719d-49aa-b00b-a23661cd2358-tmp-dir\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806742 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806765 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b905f9-e91d-4a54-b373-460596807036-serving-cert\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806779 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806826 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806849 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806851 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806877 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806894 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806910 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806925 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806948 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.806986 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807012 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807027 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807106 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807245 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-tmp\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807244 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807274 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.807343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807350 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807384 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807404 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807462 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807491 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ch52\" (UniqueName: \"kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807513 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807527 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807552 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjsj\" (UniqueName: \"kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807556 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a984a632-aac0-4b55-8e45-5da4ff687d91-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807585 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807692 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807760 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807812 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807853 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807884 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807950 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.807979 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.807997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808004 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808029 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808060 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808083 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808098 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808105 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b905f9-e91d-4a54-b373-460596807036-tmp\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808112 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808138 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808161 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808239 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pbdc\" (UniqueName: \"kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc\") pod \"migrator-66df5d496b-r88q5\" (UID: \"cc7055f3-cf05-4ec4-b101-3dbb34889de5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808261 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrr2\" (UniqueName: \"kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808278 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.808587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808298 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-stats-auth\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808294 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808710 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkht4\" (UniqueName: \"kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808742 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808758 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808791 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808877 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808902 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-tuned\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.808991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808924 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.808997 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809047 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809049 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtmj\" (UniqueName: \"kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809082 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809109 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809145 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809170 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.809247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809186 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.809687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809554 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.809687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809604 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.809687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809640 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.809888 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809697 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.809888 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809715 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.809888 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809787 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnq75\" (UniqueName: \"kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75\") pod \"kas-connection-checker-685895c7c9-ktphf\" (UID: \"c71ff75b-812f-45b8-9d99-58324eea7954\") " pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:12.809888 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809820 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.810044 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809891 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95de3b39-ddde-46a0-aef0-47358e3b8c5a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.810044 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.809984 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.810044 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810024 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.810165 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810087 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc656f1-a57e-4676-a1e7-12d09a6186c7-tmp-dir\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.810165 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810119 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfw7q\" (UniqueName: \"kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.810165 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810145 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810166 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810190 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810210 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810238 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810261 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr65f\" (UniqueName: \"kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.810294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810276 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810295 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810321 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810341 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxht\" (UniqueName: \"kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht\") pod \"kas-connection-checker-685895c7c9-gkpc2\" (UID: \"3ab95ff4-c0b4-4739-8727-3cae87d8b87b\") " pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810360 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810385 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810411 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqb4\" (UniqueName: \"kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810431 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810450 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810482 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810497 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810517 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.810551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810537 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629bn\" (UniqueName: \"kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810564 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810579 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810598 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810804 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810803 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-config\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810834 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810875 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810912 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810940 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.810972 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811007 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4p8v\" (UniqueName: \"kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811040 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5rjs\" (UniqueName: \"kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs\") pod \"volume-data-source-validator-58c9f5f46d-z7hgk\" (UID: \"7ab49653-7792-4182-afba-ed10eed2d1a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811078 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811110 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811142 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.811191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811185 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811349 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-service-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811374 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/714fc0ae-5c6c-4738-8bea-54bf573f85ff-serving-cert\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811392 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811427 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811467 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811522 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfcww\" (UniqueName: \"kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811548 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811568 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfmq\" (UniqueName: \"kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.811850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.811802 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/714fc0ae-5c6c-4738-8bea-54bf573f85ff-config\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.812246 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.812087 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-default-certificate\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.812313 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.812293 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be228dc0-014f-43a6-99c9-dfc7cdd45b37-trusted-ca\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.812707 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.812689 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.812869 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.812852 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a984a632-aac0-4b55-8e45-5da4ff687d91-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.847458 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.847434 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 05:49:12.850025 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.850008 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.852698 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.852680 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.870327 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.870304 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9bs\" (UniqueName: \"kubernetes.io/projected/528189d9-79b8-4ab9-82b0-88108f123fbd-kube-api-access-vj9bs\") pod \"kas-connection-checker-685895c7c9-n7dfn\" (UID: \"528189d9-79b8-4ab9-82b0-88108f123fbd\") " pod="kube-system/kas-connection-checker-685895c7c9-n7dfn" Nov 04 05:49:12.871217 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.871195 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvb64\" (UniqueName: \"kubernetes.io/projected/ab950d8a-b6ef-497c-8521-63af4c6f6fda-kube-api-access-zvb64\") pod \"network-check-source-6f78d59f99-bhng4\" (UID: \"ab950d8a-b6ef-497c-8521-63af4c6f6fda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-bhng4" Nov 04 05:49:12.871318 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.871264 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdd8l\" (UniqueName: \"kubernetes.io/projected/b64f4769-591b-4958-8c40-1fc53f719b6e-kube-api-access-sdd8l\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.871378 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.871349 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2rq\" (UniqueName: \"kubernetes.io/projected/f787e527-00b4-405e-8c51-3df6dea1f644-kube-api-access-nm2rq\") pod \"network-check-target-6vqw4\" (UID: \"f787e527-00b4-405e-8c51-3df6dea1f644\") " pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:12.871470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.871445 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wsx8\" (UniqueName: \"kubernetes.io/projected/be228dc0-014f-43a6-99c9-dfc7cdd45b37-kube-api-access-7wsx8\") pod \"console-operator-7cd56b8dbc-2x2d7\" (UID: \"be228dc0-014f-43a6-99c9-dfc7cdd45b37\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:12.871753 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.871723 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.873350 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.873334 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrr2\" (UniqueName: \"kubernetes.io/projected/714fc0ae-5c6c-4738-8bea-54bf573f85ff-kube-api-access-rsrr2\") pod \"service-ca-operator-544d749c8c-zdcds\" (UID: \"714fc0ae-5c6c-4738-8bea-54bf573f85ff\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" Nov 04 05:49:12.874010 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.873994 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ch52\" (UniqueName: \"kubernetes.io/projected/a984a632-aac0-4b55-8e45-5da4ff687d91-kube-api-access-8ch52\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-jp679\" (UID: \"a984a632-aac0-4b55-8e45-5da4ff687d91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" Nov 04 05:49:12.874827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.874811 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.875154 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.875139 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnq75\" (UniqueName: \"kubernetes.io/projected/c71ff75b-812f-45b8-9d99-58324eea7954-kube-api-access-wnq75\") pod \"kas-connection-checker-685895c7c9-ktphf\" (UID: \"c71ff75b-812f-45b8-9d99-58324eea7954\") " pod="kube-system/kas-connection-checker-685895c7c9-ktphf" Nov 04 05:49:12.878435 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.878418 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.878828 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.878810 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.879003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.878985 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxht\" (UniqueName: \"kubernetes.io/projected/3ab95ff4-c0b4-4739-8727-3cae87d8b87b-kube-api-access-gsxht\") pod \"kas-connection-checker-685895c7c9-gkpc2\" (UID: \"3ab95ff4-c0b4-4739-8727-3cae87d8b87b\") " pod="kube-system/kas-connection-checker-685895c7c9-gkpc2" Nov 04 05:49:12.879079 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.879038 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr65f\" (UniqueName: \"kubernetes.io/projected/06220383-5a68-47d0-82ec-240a4f52379d-kube-api-access-lr65f\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.882364 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.882348 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5rjs\" (UniqueName: \"kubernetes.io/projected/7ab49653-7792-4182-afba-ed10eed2d1a1-kube-api-access-z5rjs\") pod \"volume-data-source-validator-58c9f5f46d-z7hgk\" (UID: \"7ab49653-7792-4182-afba-ed10eed2d1a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-z7hgk" Nov 04 05:49:12.883975 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.883955 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfcww\" (UniqueName: \"kubernetes.io/projected/95de3b39-ddde-46a0-aef0-47358e3b8c5a-kube-api-access-jfcww\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.884076 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.884060 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfmq\" (UniqueName: \"kubernetes.io/projected/1074f5dc-50ec-4134-b826-aa6be14d2e1f-kube-api-access-tdfmq\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.893759 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.893743 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.893813 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.893773 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.893858 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.893840 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 05:49:12.893858 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.893851 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894019 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894004 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 05:49:12.894066 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894033 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 05:49:12.894103 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894073 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894103 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894078 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.894285 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894270 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.894339 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894320 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894339 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894324 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894497 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894467 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 05:49:12.894497 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894474 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 05:49:12.894497 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894490 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.894619 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894492 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.894619 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894491 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 05:49:12.894708 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894689 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894765 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894715 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.894765 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894759 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 05:49:12.894822 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894769 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 05:49:12.894879 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894868 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 05:49:12.894939 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894927 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\"" Nov 04 05:49:12.894939 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.894930 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 05:49:12.895022 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895009 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.895077 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895037 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.895126 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895064 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 05:49:12.895188 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895173 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 05:49:12.895245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895181 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\"" Nov 04 05:49:12.895245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895209 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 05:49:12.895245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895221 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.895245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895233 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5ph5l\"" Nov 04 05:49:12.895245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895237 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\"" Nov 04 05:49:12.895412 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895254 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 05:49:12.895412 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895256 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 05:49:12.895412 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895240 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895446 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895452 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-n5d8l\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895495 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895516 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895521 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\"" Nov 04 05:49:12.895547 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895532 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a037747-8bc9-4521-bf55-cc2bfabbf819-konnectivity-ca\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895554 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895565 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895576 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895585 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895586 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895588 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895606 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895639 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895673 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895680 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895700 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58k5t\"" Nov 04 05:49:12.895827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895740 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\"" Nov 04 05:49:12.896279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895893 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\"" Nov 04 05:49:12.896279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.895935 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\"" Nov 04 05:49:12.896279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896018 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 05:49:12.896279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896051 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 05:49:12.896441 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896309 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 05:49:12.896498 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896478 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3250c-1086-420a-8645-e9eb443bf85f-cert\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:12.896543 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896493 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea482e24-86b9-4576-9259-fe6adc58a9c3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:12.896543 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896524 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27e10948-a9fa-4c51-bf42-20737f98c93b-iptables-alerter-script\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.896605 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.896564 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-script-lib\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.897344 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.897329 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df28b9cd-719d-49aa-b00b-a23661cd2358-config-volume\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.897389 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.897375 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.897432 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.897419 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7204797-c3d2-45b2-b664-d7719428b23a-ovn-node-metrics-cert\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.897523 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.897509 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.898588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898566 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-cni-binary-copy\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.898588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898576 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-ovnkube-config\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.898588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898583 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a037747-8bc9-4521-bf55-cc2bfabbf819-agent-certs\") pod \"konnectivity-agent-swhsx\" (UID: \"7a037747-8bc9-4521-bf55-cc2bfabbf819\") " pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:49:12.898789 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898754 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqb4\" (UniqueName: \"kubernetes.io/projected/207d14c9-591c-48e1-83a0-4ef555a1060c-kube-api-access-lmqb4\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.898789 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898779 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfw7q\" (UniqueName: \"kubernetes.io/projected/27e10948-a9fa-4c51-bf42-20737f98c93b-kube-api-access-kfw7q\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.898912 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.898897 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg68w\" (UniqueName: \"kubernetes.io/projected/2fc656f1-a57e-4676-a1e7-12d09a6186c7-kube-api-access-mg68w\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.900811 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.900793 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/476606ea-919f-4515-9203-8b2037dc7c51-original-pull-secret\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.900858 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.900802 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7204797-c3d2-45b2-b664-d7719428b23a-env-overrides\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.901160 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901128 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlk98\" (UniqueName: \"kubernetes.io/projected/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-api-access-mlk98\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.901228 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901210 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-daemon-config\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.901295 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901274 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwp7\" (UniqueName: \"kubernetes.io/projected/df28b9cd-719d-49aa-b00b-a23661cd2358-kube-api-access-jbwp7\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.901328 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901311 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85927\" (UniqueName: \"kubernetes.io/projected/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-kube-api-access-85927\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:12.901362 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901274 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kube-api-access-v2xb2\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.901404 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.901390 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjsj\" (UniqueName: \"kubernetes.io/projected/149702ab-12dd-47a1-80b5-efbe1efad1af-kube-api-access-8bjsj\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.902948 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.902927 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8fa3018-a250-4075-a258-3a8061e11466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.903061 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.903041 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b905f9-e91d-4a54-b373-460596807036-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.904316 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.904299 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4p8v\" (UniqueName: \"kubernetes.io/projected/f8fa3018-a250-4075-a258-3a8061e11466-kube-api-access-p4p8v\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.904418 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.904304 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pbdc\" (UniqueName: \"kubernetes.io/projected/cc7055f3-cf05-4ec4-b101-3dbb34889de5-kube-api-access-8pbdc\") pod \"migrator-66df5d496b-r88q5\" (UID: \"cc7055f3-cf05-4ec4-b101-3dbb34889de5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r88q5" Nov 04 05:49:12.904477 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.904440 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkht4\" (UniqueName: \"kubernetes.io/projected/b7204797-c3d2-45b2-b664-d7719428b23a-kube-api-access-lkht4\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.904551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.904530 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtmj\" (UniqueName: \"kubernetes.io/projected/f0b905f9-e91d-4a54-b373-460596807036-kube-api-access-fgtmj\") pod \"insights-operator-7c4986d449-6t5rr\" (UID: \"f0b905f9-e91d-4a54-b373-460596807036\") " pod="openshift-insights/insights-operator-7c4986d449-6t5rr" Nov 04 05:49:12.904593 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.904584 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629bn\" (UniqueName: \"kubernetes.io/projected/f4d3250c-1086-420a-8645-e9eb443bf85f-kube-api-access-629bn\") pod \"ingress-canary-qzjcp\" (UID: \"f4d3250c-1086-420a-8645-e9eb443bf85f\") " pod="openshift-ingress-canary/ingress-canary-qzjcp" Nov 04 05:49:12.912315 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912297 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912400 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912325 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:12.912400 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912341 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.912400 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912358 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912400 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912381 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912419 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-etc-kubernetes\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912405 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912441 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-hostroot\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.912451 4932 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912441 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-ovn\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912471 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-kubelet-config\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912472 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912496 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912527 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.912538 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.412522452 +0000 UTC m=+1.909917217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912559 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912567 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912591 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912607 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912607 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-etc-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912561 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-multus-certs\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.912637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912637 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912657 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-cnibin\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.912665 4932 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912762 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.912775 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.412760821 +0000 UTC m=+1.910155577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912800 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-var-lib-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912806 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-device-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912806 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912833 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-multus\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912851 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912879 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912908 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912926 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-conf-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912934 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912957 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912962 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912973 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912984 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27e10948-a9fa-4c51-bf42-20737f98c93b-host-slash\") pod \"iptables-alerter-tnkp7\" (UID: \"27e10948-a9fa-4c51-bf42-20737f98c93b\") " pod="openshift-network-operator/iptables-alerter-tnkp7" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.912989 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913053 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.413045043 +0000 UTC m=+1.910439810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913066 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913090 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913093 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-k8s-cni-cncf-io\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913118 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913146 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-kubelet\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913090 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-system-cni-dir\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913170 4932 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913196 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.41318943 +0000 UTC m=+1.910584172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913211 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913227 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913243 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913258 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913274 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.913279 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913290 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-bin\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913292 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913323 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913331 4932 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913342 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-var-lib-kubelet\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913348 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-kubelet\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913345 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913358 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-kubernetes\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913363 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.413353448 +0000 UTC m=+1.910748191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : configmap "kube-rbac-proxy" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913370 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysctl-conf\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913384 4932 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913389 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-multus-socket-dir-parent\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913401 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913419 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913430 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.413419141 +0000 UTC m=+1.910813883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913447 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913449 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-var-lib-cni-bin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913456 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-run\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913464 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913474 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-node-log\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913479 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913496 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913511 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913533 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-sys\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913536 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913563 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-cni-netd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913566 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913575 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-systemd-units\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913596 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913601 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-systemd\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913612 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-modprobe-d\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913616 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913629 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-system-cni-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913638 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-slash\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913649 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913616 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-lib-modules\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913666 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913686 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913708 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913710 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fc656f1-a57e-4676-a1e7-12d09a6186c7-hosts-file\") pod \"node-resolver-d6hqt\" (UID: \"2fc656f1-a57e-4676-a1e7-12d09a6186c7\") " pod="openshift-dns/node-resolver-d6hqt" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913744 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913746 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b31ca851-da8f-4b48-a061-360c4ba572ad-crio-socket\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913758 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913760 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913790 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-etc-sysconfig\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913814 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913825 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913812 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-socket-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913845 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913919 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913937 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.413921872 +0000 UTC m=+1.911316633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913941 4932 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913965 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-cnibin\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.913966 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.913981 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.413968049 +0000 UTC m=+1.911362820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914000 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914002 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-log-socket\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914016 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914054 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914058 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8fa3018-a250-4075-a258-3a8061e11466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq87s\" (UID: \"f8fa3018-a250-4075-a258-3a8061e11466\") " pod="openshift-multus/multus-additional-cni-plugins-tq87s" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914068 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64f4769-591b-4958-8c40-1fc53f719b6e-host\") pod \"node-ca-8rg9n\" (UID: \"b64f4769-591b-4958-8c40-1fc53f719b6e\") " pod="openshift-image-registry/node-ca-8rg9n" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914083 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/476606ea-919f-4515-9203-8b2037dc7c51-dbus\") pod \"global-pull-secret-syncer-xpsrx\" (UID: \"476606ea-919f-4515-9203-8b2037dc7c51\") " pod="kube-system/global-pull-secret-syncer-xpsrx" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914094 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914123 4932 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914122 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914153 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914164 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.414152735 +0000 UTC m=+1.911547493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914188 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/149702ab-12dd-47a1-80b5-efbe1efad1af-host\") pod \"tuned-gxgpb\" (UID: \"149702ab-12dd-47a1-80b5-efbe1efad1af\") " pod="openshift-cluster-node-tuning-operator/tuned-gxgpb" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914197 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914226 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914228 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-systemd\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914238 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914279 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.414263687 +0000 UTC m=+1.911658446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914269 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914236 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-sys-fs\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914310 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914329 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914344 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914364 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914379 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914414 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-run-openvswitch\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914424 4932 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914430 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-run-netns\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914431 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65672e16-9e00-4ac7-85fa-5bcfe335cf5e-registration-dir\") pod \"aws-ebs-csi-driver-node-wjj54\" (UID: \"65672e16-9e00-4ac7-85fa-5bcfe335cf5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjj54" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914452 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914423 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207d14c9-591c-48e1-83a0-4ef555a1060c-host-run-netns\") pod \"multus-nxlbs\" (UID: \"207d14c9-591c-48e1-83a0-4ef555a1060c\") " pod="openshift-multus/multus-nxlbs" Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:12.914458 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.414449563 +0000 UTC m=+1.911844305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:12.914571 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:12.914490 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7204797-c3d2-45b2-b664-d7719428b23a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znv7k\" (UID: \"b7204797-c3d2-45b2-b664-d7719428b23a\") " pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:13.038241 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.038170 4932 scope.go:122] "RemoveContainer" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" Nov 04 05:49:13.419531 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419448 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:13.419531 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419497 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:13.419531 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419526 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419553 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419586 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419594 4932 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419616 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419634 4932 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419650 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419631262 +0000 UTC m=+2.917026027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419602 4932 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419684 4932 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419687 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419677069 +0000 UTC m=+2.917071827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419688 4932 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419785 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419766501 +0000 UTC m=+2.917161252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : configmap "kube-rbac-proxy" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419810 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419800049 +0000 UTC m=+2.917194807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419831 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419821842 +0000 UTC m=+2.917216596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.419853 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.419843676 +0000 UTC m=+2.917238437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419902 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419927 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:13.419974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419957 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.419988 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.420022 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420027 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420071 4932 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420074 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420088 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420117 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.42010918 +0000 UTC m=+2.917503936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420130 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.42012428 +0000 UTC m=+2.917519022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420075 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420149 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.420144559 +0000 UTC m=+2.917539301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420042 4932 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420174 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.420169848 +0000 UTC m=+2.917564590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420029 4932 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:13.420508 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.420211 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.420202087 +0000 UTC m=+2.917596872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:13.669765 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.669677 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/2.log" Nov 04 05:49:13.670221 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.670201 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/1.log" Nov 04 05:49:13.670292 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.670243 4932 generic.go:356] "Generic (PLEG): container finished" podID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" exitCode=255 Nov 04 05:49:13.670350 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.670323 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerDied","Data":"aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807"} Nov 04 05:49:13.670406 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.670392 4932 scope.go:122] "RemoveContainer" containerID="5a0581cc645a55dc6942c6f3ac9dfd6b04dcee7a598a253d517719b04123d097" Nov 04 05:49:13.670758 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:13.670740 4932 scope.go:122] "RemoveContainer" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" Nov 04 05:49:13.670938 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:13.670919 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:14.427352 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427320 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:14.427352 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427354 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427391 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427412 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427433 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427452 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427465 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427491 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427469 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427509 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427514 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427520 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427570 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.42755054 +0000 UTC m=+4.924945297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427581 4932 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427542 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427597 4932 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:14.427612 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427536 4932 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427599 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427583323 +0000 UTC m=+4.924978085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427540 4932 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427479 4932 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427669 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427655742 +0000 UTC m=+4.925050485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427488 4932 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427683 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427677234 +0000 UTC m=+4.925071976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427694 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427688955 +0000 UTC m=+4.925083697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427706 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427700852 +0000 UTC m=+4.925095594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427719 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427712575 +0000 UTC m=+4.925107317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427766 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427757303 +0000 UTC m=+4.925152045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427788 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.427779162 +0000 UTC m=+4.925173905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427836 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.427858 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.427973 4932 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:14.428089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:14.428013 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.428003528 +0000 UTC m=+4.925398270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:14.428526 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.428334 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b31ca851-da8f-4b48-a061-360c4ba572ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:14.674589 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.674558 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/2.log" Nov 04 05:49:14.801244 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:14.801223 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swhsx" Nov 04 05:49:15.469678 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:15.469646 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:15.735023 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:15.734942 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:15.735372 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:15.735128 4932 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:16.445988 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.445944 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:16.446179 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.445998 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:16.446179 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446088 4932 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 05:49:16.446179 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446104 4932 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:16.446179 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446143 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls podName:df28b9cd-719d-49aa-b00b-a23661cd2358 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446131213 +0000 UTC m=+8.943525955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls") pod "dns-default-9g4nv" (UID: "df28b9cd-719d-49aa-b00b-a23661cd2358") : secret "dns-default-metrics-tls" not found Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446176 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446196 4932 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446224 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446212913 +0000 UTC m=+8.943607655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446242 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446270 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446290 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446283239 +0000 UTC m=+8.943677981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446313 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:16.446335 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446337 4932 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446346 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446331504 +0000 UTC m=+8.943726260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446384 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446374138 +0000 UTC m=+8.943768880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446404 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446412 4932 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446428 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446461 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446492 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls podName:06220383-5a68-47d0-82ec-240a4f52379d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446475855 +0000 UTC m=+8.943870612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-vhkkh" (UID: "06220383-5a68-47d0-82ec-240a4f52379d") : secret "samples-operator-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446524 4932 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446533 4932 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.446537 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446560 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446547973 +0000 UTC m=+8.943942733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446582 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446570334 +0000 UTC m=+8.943965086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446495 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446604 4932 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446612 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5696797f45-ck8gh: secret "image-registry-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446618 4932 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dd4d4d8d-cpcjd: secret "image-registry-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446648 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls podName:ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446638062 +0000 UTC m=+8.944032807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls") pod "image-registry-5696797f45-ck8gh" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f") : secret "image-registry-tls" not found Nov 04 05:49:16.446686 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:16.446659 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls podName:87d09be3-b2b9-4af4-ad01-dbb9c49315bb nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.446654247 +0000 UTC m=+8.944048989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls") pod "image-registry-85dd4d4d8d-cpcjd" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb") : secret "image-registry-tls" not found Nov 04 05:49:16.877938 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:16.877906 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:18.354095 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:18.354071 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d6hqt_2fc656f1-a57e-4676-a1e7-12d09a6186c7/dns-node-resolver/0.log" Nov 04 05:49:18.981815 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:18.981790 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8rg9n_b64f4769-591b-4958-8c40-1fc53f719b6e/node-ca/0.log" Nov 04 05:49:19.982333 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:19.982307 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzjcp_f4d3250c-1086-420a-8645-e9eb443bf85f/serve-healthcheck-canary/0.log" Nov 04 05:49:19.995416 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:19.995390 4932 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:19.995789 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:19.995722 4932 scope.go:122] "RemoveContainer" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" Nov 04 05:49:19.995994 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:19.995973 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:20.383996 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.383886 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-r88q5_cc7055f3-cf05-4ec4-b101-3dbb34889de5/migrator/0.log" Nov 04 05:49:20.488493 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488458 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:20.488650 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488500 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:20.488650 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488539 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:20.488650 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488589 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:20.488650 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488633 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488655 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488674 4932 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488757 4932 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488767 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls podName:95de3b39-ddde-46a0-aef0-47358e3b8c5a nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.488746622 +0000 UTC m=+16.986141378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-g9clx" (UID: "95de3b39-ddde-46a0-aef0-47358e3b8c5a") : secret "cluster-monitoring-operator-tls" not found Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488772 4932 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488792 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488807 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls podName:b31ca851-da8f-4b48-a061-360c4ba572ad nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.488792605 +0000 UTC m=+16.986187367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pthc4" (UID: "b31ca851-da8f-4b48-a061-360c4ba572ad") : secret "insights-runtime-extractor-tls" not found Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488836 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.488827576 +0000 UTC m=+16.986222325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : configmap references non-existent config key: service-ca.crt Nov 04 05:49:20.488865 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.488848 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs podName:1074f5dc-50ec-4134-b826-aa6be14d2e1f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.488842413 +0000 UTC m=+16.986237154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs") pod "router-default-5c558747f-x6r92" (UID: "1074f5dc-50ec-4134-b826-aa6be14d2e1f") : secret "router-metrics-certs-default" not found Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488898 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488920 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488947 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.488952 4932 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.489014 4932 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.489037 4932 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.489051 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs podName:347a5e41-f3cc-42fe-8aef-1b54bec4d15d nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.489039357 +0000 UTC m=+16.986434117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs") pod "network-metrics-daemon-rcfhb" (UID: "347a5e41-f3cc-42fe-8aef-1b54bec4d15d") : secret "metrics-daemon-secret" not found Nov 04 05:49:20.489361 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:20.489072 4932 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert podName:ea482e24-86b9-4576-9259-fe6adc58a9c3 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.489062658 +0000 UTC m=+16.986457416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-9x87d" (UID: "ea482e24-86b9-4576-9259-fe6adc58a9c3") : secret "networking-console-plugin-cert" not found Nov 04 05:49:20.491262 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.491233 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"image-registry-85dd4d4d8d-cpcjd\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:20.491262 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.491252 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"image-registry-5696797f45-ck8gh\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:20.491447 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.491432 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df28b9cd-719d-49aa-b00b-a23661cd2358-metrics-tls\") pod \"dns-default-9g4nv\" (UID: \"df28b9cd-719d-49aa-b00b-a23661cd2358\") " pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:20.491617 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.491597 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06220383-5a68-47d0-82ec-240a4f52379d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-vhkkh\" (UID: \"06220383-5a68-47d0-82ec-240a4f52379d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:20.542721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.542696 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" Nov 04 05:49:20.542849 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.542746 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:20.551545 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.551526 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:20.552618 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.552593 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:20.583961 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.583941 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-jp679_a984a632-aac0-4b55-8e45-5da4ff687d91/kube-storage-version-migrator-operator/0.log" Nov 04 05:49:20.980682 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:20.980656 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh"] Nov 04 05:49:21.038214 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.038192 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:21.064170 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.064153 4932 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:49:21.077782 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:21.077757 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d09be3_b2b9_4af4_ad01_dbb9c49315bb.slice/crio-6227259c7b68fc7ba649139a22c7d91b24d67acfcdeeb3e50293756dbf1f8f38 WatchSource:0}: Error finding container 6227259c7b68fc7ba649139a22c7d91b24d67acfcdeeb3e50293756dbf1f8f38: Status 404 returned error can't find the container with id 6227259c7b68fc7ba649139a22c7d91b24d67acfcdeeb3e50293756dbf1f8f38 Nov 04 05:49:21.100807 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.100788 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9g4nv"] Nov 04 05:49:21.103914 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:21.103888 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf28b9cd_719d_49aa_b00b_a23661cd2358.slice/crio-0472d207976afe6cfeb6574d4140866acf552c13344c72db5372553f5f036c3b WatchSource:0}: Error finding container 0472d207976afe6cfeb6574d4140866acf552c13344c72db5372553f5f036c3b: Status 404 returned error can't find the container with id 0472d207976afe6cfeb6574d4140866acf552c13344c72db5372553f5f036c3b Nov 04 05:49:21.104077 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.104056 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:49:21.106164 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:21.106144 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba82dfd0_c2ad_4b30_ac55_26b8fa83fb2f.slice/crio-5be38b41253c837443a62cd8d433f1200a7a039f51c4af6a91b2e9777179cf21 WatchSource:0}: Error finding container 5be38b41253c837443a62cd8d433f1200a7a039f51c4af6a91b2e9777179cf21: Status 404 returned error can't find the container with id 5be38b41253c837443a62cd8d433f1200a7a039f51c4af6a91b2e9777179cf21 Nov 04 05:49:21.698944 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.698911 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" event={"ID":"87d09be3-b2b9-4af4-ad01-dbb9c49315bb","Type":"ContainerStarted","Data":"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca"} Nov 04 05:49:21.699127 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.698977 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" event={"ID":"87d09be3-b2b9-4af4-ad01-dbb9c49315bb","Type":"ContainerStarted","Data":"6227259c7b68fc7ba649139a22c7d91b24d67acfcdeeb3e50293756dbf1f8f38"} Nov 04 05:49:21.700069 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.700043 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" event={"ID":"06220383-5a68-47d0-82ec-240a4f52379d","Type":"ContainerStarted","Data":"5276b5b46df5257da57fb3f2cb710afe9f63745587e7065e7dd3e918c1b56c95"} Nov 04 05:49:21.701482 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.701444 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" event={"ID":"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f","Type":"ContainerStarted","Data":"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522"} Nov 04 05:49:21.701565 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.701501 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" event={"ID":"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f","Type":"ContainerStarted","Data":"5be38b41253c837443a62cd8d433f1200a7a039f51c4af6a91b2e9777179cf21"} Nov 04 05:49:21.702533 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:21.702517 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9g4nv" event={"ID":"df28b9cd-719d-49aa-b00b-a23661cd2358","Type":"ContainerStarted","Data":"0472d207976afe6cfeb6574d4140866acf552c13344c72db5372553f5f036c3b"} Nov 04 05:49:22.010775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.010719 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:22.011162 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.011148 4932 scope.go:122] "RemoveContainer" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" Nov 04 05:49:22.011352 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:22.011331 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:22.330497 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.330416 4932 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-0.us-west-1.compute.internal" event="NodeReady" Nov 04 05:49:22.707466 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.707359 4932 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:22.707703 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.707676 4932 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:22.752582 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:22.752550 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znv7k" Nov 04 05:49:24.611692 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.611664 4932 scope.go:122] "RemoveContainer" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" Nov 04 05:49:24.718267 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.718226 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" event={"ID":"06220383-5a68-47d0-82ec-240a4f52379d","Type":"ContainerStarted","Data":"5eeff3881bd5dc5577c0a5a8bea08477c25f41a8a8e81ebf4af0ffec02dcd1da"} Nov 04 05:49:24.718430 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.718294 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-vhkkh" event={"ID":"06220383-5a68-47d0-82ec-240a4f52379d","Type":"ContainerStarted","Data":"7f57d7835dc2484fa13a412b7cfdf873399bb07a921325138cfc991244c57dc2"} Nov 04 05:49:24.720487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.720463 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/2.log" Nov 04 05:49:24.720612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.720589 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerStarted","Data":"816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d"} Nov 04 05:49:24.720963 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.720940 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:24.722955 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.722919 4932 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-2x2d7 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Nov 04 05:49:24.723058 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.722980 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Nov 04 05:49:24.724415 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.724395 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9g4nv" event={"ID":"df28b9cd-719d-49aa-b00b-a23661cd2358","Type":"ContainerStarted","Data":"c32e233a58a73c86e8922e4634e52b3bafa2260c5b7f866d06edbf0b996d1ba1"} Nov 04 05:49:24.724513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.724432 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9g4nv" event={"ID":"df28b9cd-719d-49aa-b00b-a23661cd2358","Type":"ContainerStarted","Data":"f7e32cfad3732e89f817ad13077116c979f5fa9a5395567d1fe91230d6bafceb"} Nov 04 05:49:24.724513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:24.724502 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:25.728475 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.728451 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:49:25.728900 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.728885 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/2.log" Nov 04 05:49:25.728950 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.728917 4932 generic.go:356] "Generic (PLEG): container finished" podID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerID="816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d" exitCode=255 Nov 04 05:49:25.729013 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.728999 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerDied","Data":"816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d"} Nov 04 05:49:25.729059 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.729037 4932 scope.go:122] "RemoveContainer" containerID="aa6be313a1cd0b64c74d77b254d740eb5542e0b48f5fb0d2191c71f67f290807" Nov 04 05:49:25.729255 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:25.729235 4932 scope.go:122] "RemoveContainer" containerID="816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d" Nov 04 05:49:25.729478 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:25.729453 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:26.733589 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:26.733563 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:49:26.734107 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:26.733974 4932 scope.go:122] "RemoveContainer" containerID="816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d" Nov 04 05:49:26.734215 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:26.734192 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:27.289166 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:27.289133 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:27.825155 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:27.825127 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:28.557583 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557548 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:28.557583 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557591 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:28.557844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557615 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:28.557844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557678 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:28.557844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557716 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:28.557844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.557770 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:28.558345 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.558321 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1074f5dc-50ec-4134-b826-aa6be14d2e1f-service-ca-bundle\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:28.560271 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.560245 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea482e24-86b9-4576-9259-fe6adc58a9c3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-9x87d\" (UID: \"ea482e24-86b9-4576-9259-fe6adc58a9c3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:28.560508 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.560480 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b31ca851-da8f-4b48-a061-360c4ba572ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pthc4\" (UID: \"b31ca851-da8f-4b48-a061-360c4ba572ad\") " pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:28.560603 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.560581 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1074f5dc-50ec-4134-b826-aa6be14d2e1f-metrics-certs\") pod \"router-default-5c558747f-x6r92\" (UID: \"1074f5dc-50ec-4134-b826-aa6be14d2e1f\") " pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:28.560757 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.560720 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/347a5e41-f3cc-42fe-8aef-1b54bec4d15d-metrics-certs\") pod \"network-metrics-daemon-rcfhb\" (UID: \"347a5e41-f3cc-42fe-8aef-1b54bec4d15d\") " pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:28.560827 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.560807 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95de3b39-ddde-46a0-aef0-47358e3b8c5a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-g9clx\" (UID: \"95de3b39-ddde-46a0-aef0-47358e3b8c5a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:28.637159 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.637125 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" Nov 04 05:49:28.639301 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.639279 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:28.643393 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.643377 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" Nov 04 05:49:28.648522 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.648501 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcfhb" Nov 04 05:49:28.653666 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:28.653652 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pthc4" Nov 04 05:49:29.098527 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.098448 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx"] Nov 04 05:49:29.144541 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:29.144511 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95de3b39_ddde_46a0_aef0_47358e3b8c5a.slice/crio-e5d2d52888d96f5fad22885b3e571021f75757293f6b7b49685d0f87709c4d1b WatchSource:0}: Error finding container e5d2d52888d96f5fad22885b3e571021f75757293f6b7b49685d0f87709c4d1b: Status 404 returned error can't find the container with id e5d2d52888d96f5fad22885b3e571021f75757293f6b7b49685d0f87709c4d1b Nov 04 05:49:29.145467 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:29.145442 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1074f5dc_50ec_4134_b826_aa6be14d2e1f.slice/crio-8a728c87a87eeaaa0b92c90cffda49153abf22a0fc3f70c2f3184c557538aa54 WatchSource:0}: Error finding container 8a728c87a87eeaaa0b92c90cffda49153abf22a0fc3f70c2f3184c557538aa54: Status 404 returned error can't find the container with id 8a728c87a87eeaaa0b92c90cffda49153abf22a0fc3f70c2f3184c557538aa54 Nov 04 05:49:29.152021 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.152001 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c558747f-x6r92"] Nov 04 05:49:29.156002 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.155949 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pthc4"] Nov 04 05:49:29.158780 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:29.158757 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31ca851_da8f_4b48_a061_360c4ba572ad.slice/crio-75985557b15c44db0c16fd86374ee5dab27d9ceff1142f4e41b964bab9098205 WatchSource:0}: Error finding container 75985557b15c44db0c16fd86374ee5dab27d9ceff1142f4e41b964bab9098205: Status 404 returned error can't find the container with id 75985557b15c44db0c16fd86374ee5dab27d9ceff1142f4e41b964bab9098205 Nov 04 05:49:29.158950 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.158914 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-9x87d"] Nov 04 05:49:29.162522 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:29.162499 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea482e24_86b9_4576_9259_fe6adc58a9c3.slice/crio-360326e343af4cc30714b3480e5fc8f28a40efdbc3f72c19d0ab57bd6ead9348 WatchSource:0}: Error finding container 360326e343af4cc30714b3480e5fc8f28a40efdbc3f72c19d0ab57bd6ead9348: Status 404 returned error can't find the container with id 360326e343af4cc30714b3480e5fc8f28a40efdbc3f72c19d0ab57bd6ead9348 Nov 04 05:49:29.210222 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.210140 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rcfhb"] Nov 04 05:49:29.212311 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:29.212291 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347a5e41_f3cc_42fe_8aef_1b54bec4d15d.slice/crio-e8280b3b854b87cfa83ffa174ef9c9fa77608d9598891bc899d1fc486a415310 WatchSource:0}: Error finding container e8280b3b854b87cfa83ffa174ef9c9fa77608d9598891bc899d1fc486a415310: Status 404 returned error can't find the container with id e8280b3b854b87cfa83ffa174ef9c9fa77608d9598891bc899d1fc486a415310 Nov 04 05:49:29.753271 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.753226 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcfhb" event={"ID":"347a5e41-f3cc-42fe-8aef-1b54bec4d15d","Type":"ContainerStarted","Data":"e8280b3b854b87cfa83ffa174ef9c9fa77608d9598891bc899d1fc486a415310"} Nov 04 05:49:29.754920 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.754892 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c558747f-x6r92" event={"ID":"1074f5dc-50ec-4134-b826-aa6be14d2e1f","Type":"ContainerStarted","Data":"eea8b82b18c0e59f7ff8e1bae6f8a4b1f2d98d68e0234e87f63d7e411daaf837"} Nov 04 05:49:29.755047 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.754938 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c558747f-x6r92" event={"ID":"1074f5dc-50ec-4134-b826-aa6be14d2e1f","Type":"ContainerStarted","Data":"8a728c87a87eeaaa0b92c90cffda49153abf22a0fc3f70c2f3184c557538aa54"} Nov 04 05:49:29.756238 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.756213 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" event={"ID":"95de3b39-ddde-46a0-aef0-47358e3b8c5a","Type":"ContainerStarted","Data":"e5d2d52888d96f5fad22885b3e571021f75757293f6b7b49685d0f87709c4d1b"} Nov 04 05:49:29.757380 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.757346 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" event={"ID":"ea482e24-86b9-4576-9259-fe6adc58a9c3","Type":"ContainerStarted","Data":"360326e343af4cc30714b3480e5fc8f28a40efdbc3f72c19d0ab57bd6ead9348"} Nov 04 05:49:29.758775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.758757 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pthc4" event={"ID":"b31ca851-da8f-4b48-a061-360c4ba572ad","Type":"ContainerStarted","Data":"2dafdcc2db013d86d19a7836df228d53a5cf342d6bd1ef9f4ffdd95a6ccf7fef"} Nov 04 05:49:29.758853 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.758793 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pthc4" event={"ID":"b31ca851-da8f-4b48-a061-360c4ba572ad","Type":"ContainerStarted","Data":"75985557b15c44db0c16fd86374ee5dab27d9ceff1142f4e41b964bab9098205"} Nov 04 05:49:29.995842 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.995808 4932 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:29.996156 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:29.996143 4932 scope.go:122] "RemoveContainer" containerID="816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d" Nov 04 05:49:29.996356 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:29.996336 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2x2d7_openshift-console-operator(be228dc0-014f-43a6-99c9-dfc7cdd45b37)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" Nov 04 05:49:30.639970 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:30.639889 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:30.642508 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:30.642480 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:30.764411 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:30.764387 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:30.765788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:30.765767 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c558747f-x6r92" Nov 04 05:49:31.772432 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:31.772391 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-9x87d" event={"ID":"ea482e24-86b9-4576-9259-fe6adc58a9c3","Type":"ContainerStarted","Data":"38dc68e704a7eeac0147466f563354016b1e1a9e762169b2736992318b3734dc"} Nov 04 05:49:31.775009 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:31.774913 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pthc4" event={"ID":"b31ca851-da8f-4b48-a061-360c4ba572ad","Type":"ContainerStarted","Data":"ff54afd535566dc0ba0566102ebaa25ed43c08d0ba90996561d9a03796d5b985"} Nov 04 05:49:31.779436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:31.779401 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcfhb" event={"ID":"347a5e41-f3cc-42fe-8aef-1b54bec4d15d","Type":"ContainerStarted","Data":"fa33b2492872f60763de39bd57c8c3ce04d77188785013ce2c768cbe32f82f21"} Nov 04 05:49:31.779565 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:31.779468 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcfhb" event={"ID":"347a5e41-f3cc-42fe-8aef-1b54bec4d15d","Type":"ContainerStarted","Data":"e658ab15710054e52d7d7f89f1ea38226e120bd52ebad520ee9948eab54a64f3"} Nov 04 05:49:32.752984 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:32.752953 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:32.785747 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:32.785676 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-g9clx" event={"ID":"95de3b39-ddde-46a0-aef0-47358e3b8c5a","Type":"ContainerStarted","Data":"2cb795d912b47c757005d9fe4cbfe3126686da62d34aa37987fb25743a69c690"} Nov 04 05:49:33.791522 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:33.791487 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pthc4" event={"ID":"b31ca851-da8f-4b48-a061-360c4ba572ad","Type":"ContainerStarted","Data":"0b533af6c6a516a3b42ab91d2cef5aee0893744109ecce94bcad28a17ff93658"} Nov 04 05:49:34.731544 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:34.731511 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9g4nv" Nov 04 05:49:37.829587 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:37.829545 4932 patch_prober.go:29] interesting pod/image-registry-5696797f45-ck8gh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 05:49:37.830009 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:37.829612 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:49:38.443673 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:38.443627 4932 patch_prober.go:29] interesting pod/image-registry-5696797f45-ck8gh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 05:49:38.443844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:38.443695 4932 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:49:42.759834 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:42.759808 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:45.312454 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.312416 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-chb6k"] Nov 04 05:49:45.315516 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.315500 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.371220 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.371195 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 05:49:45.371407 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.371296 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjrmr\"" Nov 04 05:49:45.371407 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.371389 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 05:49:45.391872 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.391840 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-textfile\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.391887 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-sys\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.391906 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-metrics-client-ca\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392082 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392007 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-wtmp\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392082 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392051 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-root\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392082 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392071 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392115 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-accelerators-collector-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392191 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392164 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-tls\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.392261 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.392189 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g594k\" (UniqueName: \"kubernetes.io/projected/a973f739-6351-4614-8170-d01928fdb59c-kube-api-access-g594k\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.425043 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.425007 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 05:49:45.425043 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.425028 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 05:49:45.492561 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492524 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-wtmp\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492568 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-root\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492594 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492624 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-accelerators-collector-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492657 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-tls\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492683 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g594k\" (UniqueName: \"kubernetes.io/projected/a973f739-6351-4614-8170-d01928fdb59c-kube-api-access-g594k\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492698 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-wtmp\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492717 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-textfile\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.492775 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492698 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-root\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492801 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-sys\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.492829 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-metrics-client-ca\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.493038 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a973f739-6351-4614-8170-d01928fdb59c-sys\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493192 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.493163 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-textfile\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.493341 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-accelerators-collector-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.493470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.493461 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a973f739-6351-4614-8170-d01928fdb59c-metrics-client-ca\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.495090 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.495070 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.495090 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.495082 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a973f739-6351-4614-8170-d01928fdb59c-node-exporter-tls\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.556973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.556945 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g594k\" (UniqueName: \"kubernetes.io/projected/a973f739-6351-4614-8170-d01928fdb59c-kube-api-access-g594k\") pod \"node-exporter-chb6k\" (UID: \"a973f739-6351-4614-8170-d01928fdb59c\") " pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.626733 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.626659 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-chb6k" Nov 04 05:49:45.636354 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:49:45.636331 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda973f739_6351_4614_8170_d01928fdb59c.slice/crio-6d9020d0ba704645f22a1f834fbf157eca8f5609630a825fb672c48ac04b474a WatchSource:0}: Error finding container 6d9020d0ba704645f22a1f834fbf157eca8f5609630a825fb672c48ac04b474a: Status 404 returned error can't find the container with id 6d9020d0ba704645f22a1f834fbf157eca8f5609630a825fb672c48ac04b474a Nov 04 05:49:45.834994 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:45.834951 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chb6k" event={"ID":"a973f739-6351-4614-8170-d01928fdb59c","Type":"ContainerStarted","Data":"6d9020d0ba704645f22a1f834fbf157eca8f5609630a825fb672c48ac04b474a"} Nov 04 05:49:46.881772 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:46.881706 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6vqw4" Nov 04 05:49:47.367777 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:47.367744 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:49:47.829746 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:47.829699 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:49:47.844850 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:47.844816 4932 generic.go:356] "Generic (PLEG): container finished" podID="a973f739-6351-4614-8170-d01928fdb59c" containerID="100153394fdfe41a93785c34ebbca50396f38aece67b00b382ae1f861c7a55bd" exitCode=0 Nov 04 05:49:47.844992 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:47.844902 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chb6k" event={"ID":"a973f739-6351-4614-8170-d01928fdb59c","Type":"ContainerDied","Data":"100153394fdfe41a93785c34ebbca50396f38aece67b00b382ae1f861c7a55bd"} Nov 04 05:49:48.850852 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:48.850818 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chb6k" event={"ID":"a973f739-6351-4614-8170-d01928fdb59c","Type":"ContainerStarted","Data":"2f01d2d662723aeece0c728b4bc47c5647b1bf9882d135cabf7ff82424a7e356"} Nov 04 05:49:48.851257 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:48.850870 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-chb6k" event={"ID":"a973f739-6351-4614-8170-d01928fdb59c","Type":"ContainerStarted","Data":"6190cf0920757cbe669a36c8bfae415fade9461444c4e1517f9a56464b6ddbdd"} Nov 04 05:49:48.977680 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:48.977628 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-chb6k" podStartSLOduration=2.365280256 podStartE2EDuration="3.977614852s" totalImagesPullingTime="1.543839938s" totalInitContainerRuntime="68.494658ms" isStatefulPod=true podCreationTimestamp="2026-11-04 05:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:48.976922347 +0000 UTC m=+37.474317111" watchObservedRunningTime="2026-11-04 05:49:48.977614852 +0000 UTC m=+37.475009615" Nov 04 05:49:50.611079 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.611052 4932 scope.go:122] "RemoveContainer" containerID="816e68e7d2a324fd65feaa1c29b657d5056eb1e1c26a791564475b638059219d" Nov 04 05:49:50.859998 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.859972 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:49:50.860153 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.860055 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" event={"ID":"be228dc0-014f-43a6-99c9-dfc7cdd45b37","Type":"ContainerStarted","Data":"b43a9417b18404e27ca459bdfe4f62924bf6d9adf971bc77ea23f074f4c106d4"} Nov 04 05:49:50.860346 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.860318 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:50.861310 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.861259 4932 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-2x2d7 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Nov 04 05:49:50.861310 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:50.861301 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" podUID="be228dc0-014f-43a6-99c9-dfc7cdd45b37" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Nov 04 05:49:51.868121 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:51.868090 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2x2d7" Nov 04 05:49:56.552392 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:56.552304 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:49:57.775836 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:57.775794 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" podUID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" containerName="registry" containerID="cri-o://4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca" gracePeriod=30 Nov 04 05:49:58.012406 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.012384 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:58.096989 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.096916 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.096989 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.096953 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097198 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.096997 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097198 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097025 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097198 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097072 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097198 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097103 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097409 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097243 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097409 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097316 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") pod \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\" (UID: \"87d09be3-b2b9-4af4-ad01-dbb9c49315bb\") " Nov 04 05:49:58.097525 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.097403 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:49:58.098401 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.098322 4932 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-certificates\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.098843 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.098810 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:49:58.099941 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.099911 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:49:58.099941 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.099989 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "kube-api-access-jl94j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:49:58.100688 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.100033 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:49:58.100688 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.100059 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:49:58.100688 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.100087 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:49:58.104697 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.104582 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted" pod "87d09be3-b2b9-4af4-ad01-dbb9c49315bb" (UID: "87d09be3-b2b9-4af4-ad01-dbb9c49315bb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:49:58.199420 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199381 4932 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-ca-trust-extracted\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199420 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199418 4932 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-installation-pull-secrets\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199581 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199434 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl94j\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-kube-api-access-jl94j\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199581 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199451 4932 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-image-registry-private-configuration\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199581 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199468 4932 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-bound-sa-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199581 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199483 4932 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-registry-tls\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.199581 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.199498 4932 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87d09be3-b2b9-4af4-ad01-dbb9c49315bb-trusted-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:49:58.892618 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.892581 4932 generic.go:356] "Generic (PLEG): container finished" podID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" containerID="4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca" exitCode=0 Nov 04 05:49:58.893024 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.892629 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" Nov 04 05:49:58.893024 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.892633 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" event={"ID":"87d09be3-b2b9-4af4-ad01-dbb9c49315bb","Type":"ContainerDied","Data":"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca"} Nov 04 05:49:58.893024 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.892759 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dd4d4d8d-cpcjd" event={"ID":"87d09be3-b2b9-4af4-ad01-dbb9c49315bb","Type":"ContainerDied","Data":"6227259c7b68fc7ba649139a22c7d91b24d67acfcdeeb3e50293756dbf1f8f38"} Nov 04 05:49:58.893024 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.892782 4932 scope.go:122] "RemoveContainer" containerID="4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca" Nov 04 05:49:58.901545 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.901526 4932 scope.go:122] "RemoveContainer" containerID="4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca" Nov 04 05:49:58.901864 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:49:58.901843 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca\": container with ID starting with 4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca not found: ID does not exist" containerID="4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca" Nov 04 05:49:58.901932 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:58.901876 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca"} err="failed to get container status \"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca\": rpc error: code = NotFound desc = could not find container \"4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca\": container with ID starting with 4e96e68bf0c075ea5bff4d4681ed4cda297a92f142a9215a6e8e47ad5e3e96ca not found: ID does not exist" Nov 04 05:49:59.121341 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:59.121312 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:59.130353 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:59.130330 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85dd4d4d8d-cpcjd"] Nov 04 05:49:59.619213 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:49:59.619183 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" path="/var/lib/kubelet/pods/87d09be3-b2b9-4af4-ad01-dbb9c49315bb/volumes" Nov 04 05:50:17.369115 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:50:17.369074 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:50:21.571622 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.571558 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" containerID="cri-o://4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522" gracePeriod=30 Nov 04 05:50:21.816867 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.816842 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:50:21.887189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887112 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887169 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887195 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887238 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887259 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887296 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887339 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887421 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887363 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") pod \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\" (UID: \"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f\") " Nov 04 05:50:21.887844 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.887794 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:21.889092 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.888299 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:21.889955 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.889928 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:21.890100 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.890078 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:21.890193 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.890171 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:21.890271 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.890243 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:21.890448 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.890426 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "kube-api-access-7d46m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:21.896253 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.896225 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted" pod "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" (UID: "ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:50:21.977479 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.977449 4932 generic.go:356] "Generic (PLEG): container finished" podID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerID="4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522" exitCode=0 Nov 04 05:50:21.977617 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.977495 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" Nov 04 05:50:21.977617 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.977533 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" event={"ID":"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f","Type":"ContainerDied","Data":"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522"} Nov 04 05:50:21.977617 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.977585 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5696797f45-ck8gh" event={"ID":"ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f","Type":"ContainerDied","Data":"5be38b41253c837443a62cd8d433f1200a7a039f51c4af6a91b2e9777179cf21"} Nov 04 05:50:21.977617 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.977610 4932 scope.go:122] "RemoveContainer" containerID="4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522" Nov 04 05:50:21.979148 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.979116 4932 generic.go:356] "Generic (PLEG): container finished" podID="714fc0ae-5c6c-4738-8bea-54bf573f85ff" containerID="2740b8396e5d8ddb775d8d8b60332e66342f17eb948a900c66345ea434221dbe" exitCode=0 Nov 04 05:50:21.979258 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.979173 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" event={"ID":"714fc0ae-5c6c-4738-8bea-54bf573f85ff","Type":"ContainerDied","Data":"2740b8396e5d8ddb775d8d8b60332e66342f17eb948a900c66345ea434221dbe"} Nov 04 05:50:21.979470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.979455 4932 scope.go:122] "RemoveContainer" containerID="2740b8396e5d8ddb775d8d8b60332e66342f17eb948a900c66345ea434221dbe" Nov 04 05:50:21.986343 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.986329 4932 scope.go:122] "RemoveContainer" containerID="4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522" Nov 04 05:50:21.986600 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:50:21.986583 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522\": container with ID starting with 4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522 not found: ID does not exist" containerID="4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522" Nov 04 05:50:21.986659 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.986607 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522"} err="failed to get container status \"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522\": rpc error: code = NotFound desc = could not find container \"4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522\": container with ID starting with 4019750ced91547892f558b6ab8b06a180caef59953ee7c75de248918613c522 not found: ID does not exist" Nov 04 05:50:21.988036 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988013 4932 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-trusted-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988043 4932 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-installation-pull-secrets\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988060 4932 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-image-registry-private-configuration\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988074 4932 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-tls\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988090 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d46m\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-kube-api-access-7d46m\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988103 4932 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-ca-trust-extracted\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988256 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988118 4932 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-registry-certificates\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:21.988256 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:21.988131 4932 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f-bound-sa-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:22.116926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:22.116890 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:50:22.120450 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:22.120426 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5696797f45-ck8gh"] Nov 04 05:50:22.985687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:22.985651 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-zdcds" event={"ID":"714fc0ae-5c6c-4738-8bea-54bf573f85ff","Type":"ContainerStarted","Data":"ed4795c5a9951d88473201d88c1570354311743e7973b79ab6a259263b5b9217"} Nov 04 05:50:23.615616 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:23.615580 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" path="/var/lib/kubelet/pods/ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f/volumes" Nov 04 05:50:28.003056 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:28.003018 4932 generic.go:356] "Generic (PLEG): container finished" podID="a984a632-aac0-4b55-8e45-5da4ff687d91" containerID="c6f2f6ea8b22a8ee98821a67d59388967d716022518d80e47fd3f41148afe7c1" exitCode=0 Nov 04 05:50:28.003450 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:28.003064 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" event={"ID":"a984a632-aac0-4b55-8e45-5da4ff687d91","Type":"ContainerDied","Data":"c6f2f6ea8b22a8ee98821a67d59388967d716022518d80e47fd3f41148afe7c1"} Nov 04 05:50:28.003450 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:28.003365 4932 scope.go:122] "RemoveContainer" containerID="c6f2f6ea8b22a8ee98821a67d59388967d716022518d80e47fd3f41148afe7c1" Nov 04 05:50:29.008699 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:29.008665 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-jp679" event={"ID":"a984a632-aac0-4b55-8e45-5da4ff687d91","Type":"ContainerStarted","Data":"d72dfec23fdbb2efc23182b6feab5b59ae4dc04051121b047c21badac6cd33dc"} Nov 04 05:50:38.040748 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:38.040699 4932 generic.go:356] "Generic (PLEG): container finished" podID="f0b905f9-e91d-4a54-b373-460596807036" containerID="6bf4c38c9e4033b8863c8c423de396c018c333e04617c6b7f4cd591ee9fc1840" exitCode=0 Nov 04 05:50:38.041184 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:38.040763 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" event={"ID":"f0b905f9-e91d-4a54-b373-460596807036","Type":"ContainerDied","Data":"6bf4c38c9e4033b8863c8c423de396c018c333e04617c6b7f4cd591ee9fc1840"} Nov 04 05:50:38.042050 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:38.042026 4932 scope.go:122] "RemoveContainer" containerID="6bf4c38c9e4033b8863c8c423de396c018c333e04617c6b7f4cd591ee9fc1840" Nov 04 05:50:39.045957 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:50:39.045924 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6t5rr" event={"ID":"f0b905f9-e91d-4a54-b373-460596807036","Type":"ContainerStarted","Data":"8cc165a0bad53267e21c2c734b70b50ac269bef78456e1fc0b701649db28a112"} Nov 04 05:50:47.368804 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:50:47.368766 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:51:17.368828 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:51:17.368794 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:51:47.368118 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:51:47.368083 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:52:17.368156 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:52:17.368118 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:52:47.367293 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:52:47.367250 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:53:17.369151 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:53:17.369112 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:53:47.368089 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:53:47.368048 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:54:11.634997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:11.634968 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:54:11.636717 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:11.636698 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:54:17.367856 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:54:17.367808 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:54:29.440953 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.440916 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp"] Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441186 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441196 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441237 4932 cpu_manager.go:414] "containerMap: removing container" podUID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" containerName="registry" Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441242 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" containerName="registry" Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441296 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="87d09be3-b2b9-4af4-ad01-dbb9c49315bb" containerName="registry" Nov 04 05:54:29.441359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.441307 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba82dfd0-c2ad-4b30-ac55-26b8fa83fb2f" containerName="registry" Nov 04 05:54:29.444530 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.444510 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.552313 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.552279 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvsfc\" (UniqueName: \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.552474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.552327 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.552474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.552400 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.560864 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.560835 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 05:54:29.560864 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.560835 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 05:54:29.561009 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.560841 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-zjqs2\"" Nov 04 05:54:29.561869 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.561851 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp"] Nov 04 05:54:29.653579 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.653548 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvsfc\" (UniqueName: \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.653749 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.653590 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.653749 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.653641 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.654074 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.654048 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.654147 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.654075 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.720972 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.720939 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvsfc\" (UniqueName: \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:29.759044 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:29.759017 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:54:30.194563 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:30.194453 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp"] Nov 04 05:54:30.197260 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:30.197228 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9f69a8_69d7_4e6c_bd9e_220bcc6bec9a.slice/crio-6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50 WatchSource:0}: Error finding container 6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50: Status 404 returned error can't find the container with id 6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50 Nov 04 05:54:30.199315 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:30.199297 4932 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:54:30.841768 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:30.841716 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerStarted","Data":"6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50"} Nov 04 05:54:31.124915 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.124843 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm"] Nov 04 05:54:31.134314 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.134283 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.165041 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.165017 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.165179 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.165059 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9hg\" (UniqueName: \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.165221 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.165183 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.244173 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.244136 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-4qgt9\"" Nov 04 05:54:31.245659 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.245628 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7"] Nov 04 05:54:31.249460 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.249439 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm"] Nov 04 05:54:31.249582 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.249555 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.266066 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.266039 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.266185 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.266078 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.266185 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.266105 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9hg\" (UniqueName: \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.266377 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.266359 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.266507 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.266441 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.303089 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.303064 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7"] Nov 04 05:54:31.305709 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.305690 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-zh9sr\"" Nov 04 05:54:31.334981 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.334958 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4"] Nov 04 05:54:31.335971 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.335948 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9hg\" (UniqueName: \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.339035 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.339015 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.367393 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367366 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.367488 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367456 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzps\" (UniqueName: \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.367488 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367479 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.367584 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367545 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.367634 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367582 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.367634 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.367607 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7rk\" (UniqueName: \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.397349 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.397288 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-ztp2q\"" Nov 04 05:54:31.399219 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.399194 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4"] Nov 04 05:54:31.433623 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.433602 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj"] Nov 04 05:54:31.437271 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.437255 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg"] Nov 04 05:54:31.437425 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.437400 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.440551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.440533 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.449175 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.449157 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:54:31.468451 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468425 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.468563 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468488 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfqg\" (UniqueName: \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.468563 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468511 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.468677 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468569 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzps\" (UniqueName: \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.468677 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468591 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.468677 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468615 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.468677 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468638 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.468677 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468672 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.468973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468692 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9h5h\" (UniqueName: \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.468973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468712 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.468973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468743 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7rk\" (UniqueName: \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.468973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.468771 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.469265 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.469072 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.469578 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.469558 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.470037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.469766 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.470119 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.470041 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.497544 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.497516 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-bclrg\"" Nov 04 05:54:31.499808 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.498268 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj"] Nov 04 05:54:31.500845 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.500819 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg"] Nov 04 05:54:31.534201 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.534178 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzps\" (UniqueName: \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.534342 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.534318 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7rk\" (UniqueName: \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.566818 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.566792 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:54:31.569990 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.569828 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.569990 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.569874 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfqg\" (UniqueName: \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.569990 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.569895 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.570216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570191 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.570286 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570232 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.570286 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570252 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.570387 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570281 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9h5h\" (UniqueName: \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.570481 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570454 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.570603 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570252 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.570681 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.570663 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.598236 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.598204 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-7vr9n\"" Nov 04 05:54:31.634876 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.634851 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfqg\" (UniqueName: \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.636436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.636416 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9h5h\" (UniqueName: \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.661140 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.661079 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:54:31.755465 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.755434 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:54:31.762622 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.762595 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:54:31.833549 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.833254 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm"] Nov 04 05:54:31.836333 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:31.836292 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b5fd20_a39a_436e_b618_c29cbd406d8e.slice/crio-11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a WatchSource:0}: Error finding container 11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a: Status 404 returned error can't find the container with id 11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a Nov 04 05:54:31.855389 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.855352 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" event={"ID":"c2b5fd20-a39a-436e-b618-c29cbd406d8e","Type":"ContainerStarted","Data":"11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a"} Nov 04 05:54:31.950097 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:31.950012 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7"] Nov 04 05:54:31.952796 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:31.952772 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d2c740_77e2_4127_a78a_6a7588bb1d10.slice/crio-45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025 WatchSource:0}: Error finding container 45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025: Status 404 returned error can't find the container with id 45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025 Nov 04 05:54:32.052404 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.052372 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4"] Nov 04 05:54:32.054114 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:32.054082 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b92048_8d21_42ce_a25e_8fa5480c1bb3.slice/crio-07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a WatchSource:0}: Error finding container 07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a: Status 404 returned error can't find the container with id 07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a Nov 04 05:54:32.139927 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.139900 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj"] Nov 04 05:54:32.142605 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:32.142576 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9428e4dd_0f41_4fe4_8849_b7382b99b0a0.slice/crio-e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d WatchSource:0}: Error finding container e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d: Status 404 returned error can't find the container with id e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d Nov 04 05:54:32.162447 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.162425 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg"] Nov 04 05:54:32.165034 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:32.165007 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac280a2_54ea_4d95_9ec8_f175584bfc1a.slice/crio-a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0 WatchSource:0}: Error finding container a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0: Status 404 returned error can't find the container with id a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0 Nov 04 05:54:32.861862 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.861822 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" event={"ID":"b0b92048-8d21-42ce-a25e-8fa5480c1bb3","Type":"ContainerStarted","Data":"07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a"} Nov 04 05:54:32.865113 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.865077 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" event={"ID":"e0d2c740-77e2-4127-a78a-6a7588bb1d10","Type":"ContainerStarted","Data":"45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025"} Nov 04 05:54:32.867266 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.867238 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerStarted","Data":"e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d"} Nov 04 05:54:32.869721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:32.869228 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" event={"ID":"aac280a2-54ea-4d95-9ec8-f175584bfc1a","Type":"ContainerStarted","Data":"a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0"} Nov 04 05:54:33.832245 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.828535 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6"] Nov 04 05:54:33.834462 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.833686 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.889415 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.889141 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6"] Nov 04 05:54:33.890688 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.890663 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-qkgj7\"" Nov 04 05:54:33.896943 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.893119 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.896943 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.893197 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.896943 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.893236 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvng\" (UniqueName: \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.993971 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.993928 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.994132 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.993988 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvng\" (UniqueName: \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.994132 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.994066 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.994545 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.994520 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:33.994833 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:33.994808 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:34.065120 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:34.065076 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvng\" (UniqueName: \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:34.154819 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:34.154743 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:54:34.560972 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:34.560943 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6"] Nov 04 05:54:34.887310 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:34.887202 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" event={"ID":"f711cf80-bfdf-4b97-85f6-44a4b405c130","Type":"ContainerStarted","Data":"8704302a2e7626ccc52d2afa28dbe3b96d2e823f2f1eebb67ebc9433c60e6630"} Nov 04 05:54:35.756822 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.755056 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck"] Nov 04 05:54:35.759022 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.758997 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.811650 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.811612 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.811840 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.811667 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gvf\" (UniqueName: \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.811840 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.811717 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.871950 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.871836 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck"] Nov 04 05:54:35.913088 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.913055 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.913265 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.913111 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gvf\" (UniqueName: \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.913265 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.913159 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.913626 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.913604 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.913907 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.913888 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:35.980909 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:35.980846 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gvf\" (UniqueName: \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:36.084195 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:36.083911 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:54:36.508701 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:36.508668 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck"] Nov 04 05:54:36.921158 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:36.921020 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerStarted","Data":"6602350efc560cb2e40b079180beaaba7b6f42ec30696a646008ac8e164daeb6"} Nov 04 05:54:37.297898 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.297862 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 05:54:37.303554 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.303502 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.387945 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.387834 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 05:54:37.413291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.413052 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 05:54:37.413291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.413214 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kfq2b\"" Nov 04 05:54:37.442086 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442049 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442281 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442109 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmkf4\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442281 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442134 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442281 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442213 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442281 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442235 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442281 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442267 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442621 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442301 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442621 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442331 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.442621 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.442354 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.543894 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.543945 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.543985 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544363 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmkf4\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544396 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544482 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544506 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544545 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.544653 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.544581 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.547235 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.546498 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.547235 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.547003 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.547235 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.547151 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.547235 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.547191 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.547497 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.547238 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.549751 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.549645 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.560445 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.560395 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.614231 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.614164 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.630596 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.629440 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmkf4\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\") pod \"maas-default-gateway-openshift-default-6886b96f9-9lc9f\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.631234 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.631209 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv"] Nov 04 05:54:37.636640 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.636619 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.718072 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.718034 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv"] Nov 04 05:54:37.719936 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.719910 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-6h2gj\"" Nov 04 05:54:37.747143 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747104 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747301 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747161 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747301 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747283 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747414 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747343 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747414 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747371 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsrh\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-kube-api-access-ldsrh\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747414 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747406 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747567 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747429 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747567 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747458 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.747567 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.747493 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5ad66a-ac17-406c-a5b5-570f78302119-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.848817 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848709 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.848817 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848802 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848829 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsrh\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-kube-api-access-ldsrh\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848864 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848899 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848928 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.848961 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5ad66a-ac17-406c-a5b5-570f78302119-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.849009 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849339 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.849040 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.849521 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.849496 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.851062 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.849769 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.851062 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.850298 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.851062 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.850497 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5ad66a-ac17-406c-a5b5-570f78302119-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.851062 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.850832 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.853309 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.853266 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.863520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.863495 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.919679 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.919465 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsrh\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-kube-api-access-ldsrh\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.922499 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.922458 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5ad66a-ac17-406c-a5b5-570f78302119-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv\" (UID: \"1b5ad66a-ac17-406c-a5b5-570f78302119\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:37.924182 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.923027 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:37.954859 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:37.954572 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:38.398109 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:38.398000 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 05:54:38.403407 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:38.403377 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e4e943_4a9c_463f_a22a_b69e58a7b65a.slice/crio-4de8d22110d57290af98cb3e5b2598d44f09b5acf0ad84f1547029a0245a0138 WatchSource:0}: Error finding container 4de8d22110d57290af98cb3e5b2598d44f09b5acf0ad84f1547029a0245a0138: Status 404 returned error can't find the container with id 4de8d22110d57290af98cb3e5b2598d44f09b5acf0ad84f1547029a0245a0138 Nov 04 05:54:38.439402 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:38.439371 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv"] Nov 04 05:54:38.460950 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:38.460919 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5ad66a_ac17_406c_a5b5_570f78302119.slice/crio-80afef0abe7215231c52deb6fbc6cd3f514be47fa7a43ad7d8ad67c455288de8 WatchSource:0}: Error finding container 80afef0abe7215231c52deb6fbc6cd3f514be47fa7a43ad7d8ad67c455288de8: Status 404 returned error can't find the container with id 80afef0abe7215231c52deb6fbc6cd3f514be47fa7a43ad7d8ad67c455288de8 Nov 04 05:54:38.937358 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:38.937322 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" event={"ID":"1b5ad66a-ac17-406c-a5b5-570f78302119","Type":"ContainerStarted","Data":"80afef0abe7215231c52deb6fbc6cd3f514be47fa7a43ad7d8ad67c455288de8"} Nov 04 05:54:38.948109 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:38.948079 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerStarted","Data":"4de8d22110d57290af98cb3e5b2598d44f09b5acf0ad84f1547029a0245a0138"} Nov 04 05:54:39.771455 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.771423 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p"] Nov 04 05:54:39.789548 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.789520 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.803631 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.803605 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t"] Nov 04 05:54:39.807557 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.807534 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.832105 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.832081 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k"] Nov 04 05:54:39.837947 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.837929 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:39.838989 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.838966 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p"] Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.868841 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.868959 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.868991 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.869021 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjmh\" (UniqueName: \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.869065 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.869216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.869091 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bhx5\" (UniqueName: \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.871904 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.871099 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8"] Nov 04 05:54:39.875544 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.875510 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:39.887636 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.886942 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t"] Nov 04 05:54:39.896531 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.896455 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k"] Nov 04 05:54:39.933057 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.933020 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8"] Nov 04 05:54:39.970447 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970412 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970461 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bhx5\" (UniqueName: \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970494 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970527 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970561 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c52z\" (UniqueName: \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970585 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970660 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:39.970926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.970693 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:39.971305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.971174 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.971830 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.971803 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.971940 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.971916 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwst9\" (UniqueName: \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:39.972003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.971981 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.972056 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.972010 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.972056 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.972041 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjmh\" (UniqueName: \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:39.972456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.972310 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:39.972576 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:39.972525 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:40.045823 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.045367 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjmh\" (UniqueName: \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:40.048065 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.048006 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bhx5\" (UniqueName: \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.072879 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.072937 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwst9\" (UniqueName: \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073015 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073049 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073084 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c52z\" (UniqueName: \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073172 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073560 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.073878 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.074437 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.074980 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.074684 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.112543 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.112269 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:54:40.127719 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.127693 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:54:40.153639 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.153610 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwst9\" (UniqueName: \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.158313 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.158286 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:54:40.160789 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.160764 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c52z\" (UniqueName: \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.198960 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.198883 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:54:40.585817 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.585745 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t"] Nov 04 05:54:40.630687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.630655 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k"] Nov 04 05:54:40.630808 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.630743 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p"] Nov 04 05:54:40.683336 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.682136 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8"] Nov 04 05:54:40.690760 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:54:40.690713 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0098c9_9fdf_4f2f_816d_7f9998bf692e.slice/crio-4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760 WatchSource:0}: Error finding container 4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760: Status 404 returned error can't find the container with id 4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760 Nov 04 05:54:40.989415 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.989326 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" event={"ID":"fb0098c9-9fdf-4f2f-816d-7f9998bf692e","Type":"ContainerStarted","Data":"4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760"} Nov 04 05:54:40.992037 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.991949 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerStarted","Data":"67825d252b4d5bbacfd7acb0dab91a34371b5a323ab7d6f6bada49414b54418c"} Nov 04 05:54:40.994780 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:40.994691 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerStarted","Data":"5866cfe07074ea8e890260c15efa27d6eb117d2a7a3d29880df27d2bfe6aea49"} Nov 04 05:54:41.018637 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:41.018598 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" event={"ID":"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff","Type":"ContainerStarted","Data":"f8e6b70b0e4d0842e1e56409e39dbc4c77d3c4d410cb32871941a9c0130dd79d"} Nov 04 05:54:47.114468 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:47.114431 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerStarted","Data":"bef2cae940c5b2cd5d4243b574eb3fe37e604a0563ac9378c4837a1cebfd825f"} Nov 04 05:54:47.456451 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:54:47.456026 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:54:48.142780 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:48.142055 4932 generic.go:356] "Generic (PLEG): container finished" podID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerID="bef2cae940c5b2cd5d4243b574eb3fe37e604a0563ac9378c4837a1cebfd825f" exitCode=0 Nov 04 05:54:48.142780 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:48.142154 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerDied","Data":"bef2cae940c5b2cd5d4243b574eb3fe37e604a0563ac9378c4837a1cebfd825f"} Nov 04 05:54:48.150772 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:48.150173 4932 generic.go:356] "Generic (PLEG): container finished" podID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerID="bfdb2373a8af02f2543279ab018d17da5537ab550c73833aa93aa863c09d8dc4" exitCode=0 Nov 04 05:54:48.150772 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:48.150215 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" event={"ID":"f711cf80-bfdf-4b97-85f6-44a4b405c130","Type":"ContainerDied","Data":"bfdb2373a8af02f2543279ab018d17da5537ab550c73833aa93aa863c09d8dc4"} Nov 04 05:54:50.768924 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:50.768229 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:50.768924 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:50.768313 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:50.768924 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:50.768358 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:51.061885 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.061135 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:51.061885 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.061229 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:51.061885 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.061270 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:54:51.191785 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.191752 4932 generic.go:356] "Generic (PLEG): container finished" podID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerID="316a8b759b0b6516f0d8e002f55050a5026ef1894e4e9500853de05986f79b46" exitCode=0 Nov 04 05:54:51.191926 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.191863 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" event={"ID":"f711cf80-bfdf-4b97-85f6-44a4b405c130","Type":"ContainerDied","Data":"316a8b759b0b6516f0d8e002f55050a5026ef1894e4e9500853de05986f79b46"} Nov 04 05:54:51.207951 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.207915 4932 generic.go:356] "Generic (PLEG): container finished" podID="379b4075-baa7-41c9-8573-8102e72ec788" containerID="63523025d989dfe2ba22db4d518dc02992f07e6149db559d3bf59a472083dd1f" exitCode=0 Nov 04 05:54:51.208078 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.207973 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerDied","Data":"63523025d989dfe2ba22db4d518dc02992f07e6149db559d3bf59a472083dd1f"} Nov 04 05:54:51.220567 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.220530 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerStarted","Data":"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47"} Nov 04 05:54:51.461576 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.460992 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podStartSLOduration=2.110918998 podStartE2EDuration="14.460971893s" totalImagesPullingTime="12.350052895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:54:51.457980852 +0000 UTC m=+339.955375616" watchObservedRunningTime="2026-11-04 05:54:51.460971893 +0000 UTC m=+339.958366649" Nov 04 05:54:51.923431 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:51.923393 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:52.233418 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.233378 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" event={"ID":"1b5ad66a-ac17-406c-a5b5-570f78302119","Type":"ContainerStarted","Data":"dd28cdb3eead48f440a4deed780f1aceb33d7c9c12558ea448bdc7b6e64a064b"} Nov 04 05:54:52.363614 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.363559 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" podStartSLOduration=2.775632639 podStartE2EDuration="15.36353902s" totalImagesPullingTime="12.587906381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:54:52.36149332 +0000 UTC m=+340.858888106" watchObservedRunningTime="2026-11-04 05:54:52.36353902 +0000 UTC m=+340.860933779" Nov 04 05:54:52.924396 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.924267 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:52.930323 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.930053 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:52.955552 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.955397 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:52.955552 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.955452 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:52.962170 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:52.962075 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:53.246437 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.246396 4932 generic.go:356] "Generic (PLEG): container finished" podID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerID="c686655fabe6444089e37bc249d505e91973c0cd01736e19e0582fc7b362083a" exitCode=0 Nov 04 05:54:53.246687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.246659 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" event={"ID":"e0d2c740-77e2-4127-a78a-6a7588bb1d10","Type":"ContainerDied","Data":"c686655fabe6444089e37bc249d505e91973c0cd01736e19e0582fc7b362083a"} Nov 04 05:54:53.251203 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.250662 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerStarted","Data":"8ffc873e8fa3b27215c6106bfbd8993f3d7b1b2b9a3ee674cb549c6ed424cc67"} Nov 04 05:54:53.253021 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.252993 4932 generic.go:356] "Generic (PLEG): container finished" podID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerID="36222cf8bd809097fa2f489ab0a4b7644032b0cd78273c2df891affeab0fa035" exitCode=0 Nov 04 05:54:53.255820 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.254368 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" event={"ID":"c2b5fd20-a39a-436e-b618-c29cbd406d8e","Type":"ContainerDied","Data":"36222cf8bd809097fa2f489ab0a4b7644032b0cd78273c2df891affeab0fa035"} Nov 04 05:54:53.256066 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.255990 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv" Nov 04 05:54:53.256689 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:53.256429 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:54:54.263351 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.263313 4932 generic.go:356] "Generic (PLEG): container finished" podID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerID="8ffc873e8fa3b27215c6106bfbd8993f3d7b1b2b9a3ee674cb549c6ed424cc67" exitCode=0 Nov 04 05:54:54.263812 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.263434 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerDied","Data":"8ffc873e8fa3b27215c6106bfbd8993f3d7b1b2b9a3ee674cb549c6ed424cc67"} Nov 04 05:54:54.266307 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.266283 4932 generic.go:356] "Generic (PLEG): container finished" podID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerID="5a058b4aad73fd664a141d53332be65fba48ad40473f428a5df446c6aec69f25" exitCode=0 Nov 04 05:54:54.266404 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.266387 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" event={"ID":"aac280a2-54ea-4d95-9ec8-f175584bfc1a","Type":"ContainerDied","Data":"5a058b4aad73fd664a141d53332be65fba48ad40473f428a5df446c6aec69f25"} Nov 04 05:54:54.269487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.269460 4932 generic.go:356] "Generic (PLEG): container finished" podID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerID="4c4813e806e49d8a9c511a79f5bfa04d3ec633ccdb28a3a468b95b58b41cac08" exitCode=0 Nov 04 05:54:54.269583 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.269530 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerDied","Data":"4c4813e806e49d8a9c511a79f5bfa04d3ec633ccdb28a3a468b95b58b41cac08"} Nov 04 05:54:54.274583 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.274561 4932 generic.go:356] "Generic (PLEG): container finished" podID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerID="2c8de1d72035edb01b2db391aa0ab573ba21061601aae4443c1e835a1e51f3cc" exitCode=0 Nov 04 05:54:54.274651 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.274631 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" event={"ID":"b0b92048-8d21-42ce-a25e-8fa5480c1bb3","Type":"ContainerDied","Data":"2c8de1d72035edb01b2db391aa0ab573ba21061601aae4443c1e835a1e51f3cc"} Nov 04 05:54:54.278175 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.278152 4932 generic.go:356] "Generic (PLEG): container finished" podID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerID="70685ce946ed1e681a2e3419169624823a0744bdec4aed12ce0f06bc2f3b655e" exitCode=0 Nov 04 05:54:54.278320 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.278221 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerDied","Data":"70685ce946ed1e681a2e3419169624823a0744bdec4aed12ce0f06bc2f3b655e"} Nov 04 05:54:54.282020 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.281856 4932 generic.go:356] "Generic (PLEG): container finished" podID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerID="410969d114351df06ec6b9358f135b78c9e255bc23ca4580cbca4fc2900f045a" exitCode=0 Nov 04 05:54:54.282020 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.281965 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" event={"ID":"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff","Type":"ContainerDied","Data":"410969d114351df06ec6b9358f135b78c9e255bc23ca4580cbca4fc2900f045a"} Nov 04 05:54:54.285239 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.284605 4932 generic.go:356] "Generic (PLEG): container finished" podID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerID="d53c4b2aebc04581de4130ac9a9a2c7d9cdb7037bd1300624dee2c9c11b26758" exitCode=0 Nov 04 05:54:54.285239 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:54.284677 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" event={"ID":"fb0098c9-9fdf-4f2f-816d-7f9998bf692e","Type":"ContainerDied","Data":"d53c4b2aebc04581de4130ac9a9a2c7d9cdb7037bd1300624dee2c9c11b26758"} Nov 04 05:54:55.299430 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:55.299386 4932 generic.go:356] "Generic (PLEG): container finished" podID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerID="d9b2d805a5f24ca8106f41d73ba262bf8f971d4ce2833bbb331fac8ba7dd1432" exitCode=0 Nov 04 05:54:55.299918 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:55.299551 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerDied","Data":"d9b2d805a5f24ca8106f41d73ba262bf8f971d4ce2833bbb331fac8ba7dd1432"} Nov 04 05:54:55.303341 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:55.303306 4932 generic.go:356] "Generic (PLEG): container finished" podID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerID="1de7ab7cf142f4af8e0bdd4cfea40f702f9b6801ac42cf1b7675e2938ab4383a" exitCode=0 Nov 04 05:54:55.303443 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:55.303414 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" event={"ID":"e0d2c740-77e2-4127-a78a-6a7588bb1d10","Type":"ContainerDied","Data":"1de7ab7cf142f4af8e0bdd4cfea40f702f9b6801ac42cf1b7675e2938ab4383a"} Nov 04 05:54:56.313880 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.313051 4932 generic.go:356] "Generic (PLEG): container finished" podID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerID="bafc17167a0c86db531bed4983e2d53e2bb98818f73f0e7fc9b7c9d5f2ef6d2a" exitCode=0 Nov 04 05:54:56.313880 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.313116 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerDied","Data":"bafc17167a0c86db531bed4983e2d53e2bb98818f73f0e7fc9b7c9d5f2ef6d2a"} Nov 04 05:54:56.316186 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.316158 4932 generic.go:356] "Generic (PLEG): container finished" podID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerID="da59c4ff6267ab46d9d01c1232d1c34c6cf7690c272a83e48df451399739c9ee" exitCode=0 Nov 04 05:54:56.316305 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.316250 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerDied","Data":"da59c4ff6267ab46d9d01c1232d1c34c6cf7690c272a83e48df451399739c9ee"} Nov 04 05:54:56.320120 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.320088 4932 generic.go:356] "Generic (PLEG): container finished" podID="379b4075-baa7-41c9-8573-8102e72ec788" containerID="d2507e5183092f112b41be78fd67b9cb9fe778887dff0b0b6f7e5eb4c7b88d9e" exitCode=0 Nov 04 05:54:56.320231 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.320162 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerDied","Data":"d2507e5183092f112b41be78fd67b9cb9fe778887dff0b0b6f7e5eb4c7b88d9e"} Nov 04 05:54:56.323651 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.323627 4932 generic.go:356] "Generic (PLEG): container finished" podID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerID="7dbbb4e22079103b0d4b6fc42407b8baf21bb7de65f5ce1096a12c13a39ea57c" exitCode=0 Nov 04 05:54:56.323776 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.323697 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerDied","Data":"7dbbb4e22079103b0d4b6fc42407b8baf21bb7de65f5ce1096a12c13a39ea57c"} Nov 04 05:54:56.326880 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.326857 4932 generic.go:356] "Generic (PLEG): container finished" podID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerID="f2afbd0616229d94bce3be56aa9d9765b4d639d20720ca22e0d7d6055761fdf3" exitCode=0 Nov 04 05:54:56.326981 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.326963 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" event={"ID":"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff","Type":"ContainerDied","Data":"f2afbd0616229d94bce3be56aa9d9765b4d639d20720ca22e0d7d6055761fdf3"} Nov 04 05:54:56.331121 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.330547 4932 generic.go:356] "Generic (PLEG): container finished" podID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerID="78d87719a3034fb62933cebd3b1670b26c6c79856b63acfd385bc49d8a497c20" exitCode=0 Nov 04 05:54:56.331121 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:56.330614 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" event={"ID":"fb0098c9-9fdf-4f2f-816d-7f9998bf692e","Type":"ContainerDied","Data":"78d87719a3034fb62933cebd3b1670b26c6c79856b63acfd385bc49d8a497c20"} Nov 04 05:54:59.369179 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:59.368050 4932 generic.go:356] "Generic (PLEG): container finished" podID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerID="70fa2455eda2203d8af4d0ca1366bd36bcfff7cee6db8b5b4742d79f133f32dd" exitCode=0 Nov 04 05:54:59.369179 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:59.368167 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" event={"ID":"c2b5fd20-a39a-436e-b618-c29cbd406d8e","Type":"ContainerDied","Data":"70fa2455eda2203d8af4d0ca1366bd36bcfff7cee6db8b5b4742d79f133f32dd"} Nov 04 05:54:59.379600 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:59.378678 4932 generic.go:356] "Generic (PLEG): container finished" podID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerID="3b10971493e61e10398fc87bb046f80b41921e695b232dd1d17874b9787cee04" exitCode=0 Nov 04 05:54:59.379600 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:54:59.378803 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" event={"ID":"b0b92048-8d21-42ce-a25e-8fa5480c1bb3","Type":"ContainerDied","Data":"3b10971493e61e10398fc87bb046f80b41921e695b232dd1d17874b9787cee04"} Nov 04 05:55:07.533293 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:07.533255 4932 generic.go:356] "Generic (PLEG): container finished" podID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerID="f59a3582c27031febc5cb1a6fac91931b22b9e643d48a89628b28c88daaafd68" exitCode=0 Nov 04 05:55:07.533811 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:07.533345 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" event={"ID":"aac280a2-54ea-4d95-9ec8-f175584bfc1a","Type":"ContainerDied","Data":"f59a3582c27031febc5cb1a6fac91931b22b9e643d48a89628b28c88daaafd68"} Nov 04 05:55:09.565628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.565124 4932 generic.go:356] "Generic (PLEG): container finished" podID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerID="6da43d4ee14b9166860f9b063be5676c93a4e1534fb7ca36c038ae31ec97c4f8" exitCode=0 Nov 04 05:55:09.565628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.565241 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" event={"ID":"aac280a2-54ea-4d95-9ec8-f175584bfc1a","Type":"ContainerDied","Data":"6da43d4ee14b9166860f9b063be5676c93a4e1534fb7ca36c038ae31ec97c4f8"} Nov 04 05:55:09.574503 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.574474 4932 generic.go:356] "Generic (PLEG): container finished" podID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerID="959959f2b3a93b8a758ea874c97ecbe1af8e4ee0d039c04852889a5dabb54896" exitCode=0 Nov 04 05:55:09.574627 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.574557 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" event={"ID":"f711cf80-bfdf-4b97-85f6-44a4b405c130","Type":"ContainerDied","Data":"959959f2b3a93b8a758ea874c97ecbe1af8e4ee0d039c04852889a5dabb54896"} Nov 04 05:55:09.587703 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.587675 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerStarted","Data":"5f63c053c103d4d3350fb258f8440407480bfcb922ba61357ca1847608f38ae7"} Nov 04 05:55:09.944968 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:09.942266 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" podStartSLOduration=3.2228152740000002 podStartE2EDuration="30.942247106s" totalImagesPullingTime="27.719431832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:09.817936392 +0000 UTC m=+358.315331157" watchObservedRunningTime="2026-11-04 05:55:09.942247106 +0000 UTC m=+358.439641872" Nov 04 05:55:10.603621 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.603058 4932 generic.go:356] "Generic (PLEG): container finished" podID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerID="5f63c053c103d4d3350fb258f8440407480bfcb922ba61357ca1847608f38ae7" exitCode=0 Nov 04 05:55:10.603621 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.603155 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerDied","Data":"5f63c053c103d4d3350fb258f8440407480bfcb922ba61357ca1847608f38ae7"} Nov 04 05:55:10.609269 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.609237 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerStarted","Data":"ee03044dbf76bde6c5be8a0836af8d312b5046892b53bc43746428f2a32fe294"} Nov 04 05:55:10.613937 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.613908 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerStarted","Data":"6651d1e32c8b94cd7c621050e72298e6596c4212abed9fc2d5803d7c35b42199"} Nov 04 05:55:10.619393 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.619340 4932 generic.go:356] "Generic (PLEG): container finished" podID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerID="469ad66e60b88fc24ade67456c36fdc3d0dc9edf0b27454b3d8a569292f9c716" exitCode=0 Nov 04 05:55:10.619487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.619474 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" event={"ID":"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff","Type":"ContainerDied","Data":"469ad66e60b88fc24ade67456c36fdc3d0dc9edf0b27454b3d8a569292f9c716"} Nov 04 05:55:10.622492 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.622463 4932 generic.go:356] "Generic (PLEG): container finished" podID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerID="5ec85b9e298b8b8f1381c304408afabe13182f8f916a92cdfde3c9e82ed41a1d" exitCode=0 Nov 04 05:55:10.622588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.622565 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" event={"ID":"fb0098c9-9fdf-4f2f-816d-7f9998bf692e","Type":"ContainerDied","Data":"5ec85b9e298b8b8f1381c304408afabe13182f8f916a92cdfde3c9e82ed41a1d"} Nov 04 05:55:10.625378 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.625352 4932 generic.go:356] "Generic (PLEG): container finished" podID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerID="7c11b625ac400b3105d1f03bf4400332717d4bd47ac8255b582ca86e2ec4acf7" exitCode=0 Nov 04 05:55:10.625538 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.625445 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerDied","Data":"7c11b625ac400b3105d1f03bf4400332717d4bd47ac8255b582ca86e2ec4acf7"} Nov 04 05:55:10.810000 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.809922 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:55:10.846834 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.846807 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:55:10.862487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.862403 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" podStartSLOduration=3.622626371 podStartE2EDuration="31.862388625s" totalImagesPullingTime="28.239762254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:10.861278958 +0000 UTC m=+359.358673721" watchObservedRunningTime="2026-11-04 05:55:10.862388625 +0000 UTC m=+359.359783388" Nov 04 05:55:10.928055 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928025 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\" (UniqueName: \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\") pod \"f711cf80-bfdf-4b97-85f6-44a4b405c130\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " Nov 04 05:55:10.928189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928109 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\" (UniqueName: \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\") pod \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " Nov 04 05:55:10.928259 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928184 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\") pod \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " Nov 04 05:55:10.928259 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928235 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\") pod \"f711cf80-bfdf-4b97-85f6-44a4b405c130\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " Nov 04 05:55:10.928371 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928276 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\") pod \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\" (UID: \"aac280a2-54ea-4d95-9ec8-f175584bfc1a\") " Nov 04 05:55:10.928371 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.928295 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\") pod \"f711cf80-bfdf-4b97-85f6-44a4b405c130\" (UID: \"f711cf80-bfdf-4b97-85f6-44a4b405c130\") " Nov 04 05:55:10.929474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.929349 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle" pod "aac280a2-54ea-4d95-9ec8-f175584bfc1a" (UID: "aac280a2-54ea-4d95-9ec8-f175584bfc1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:10.933103 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.933046 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng" pod "f711cf80-bfdf-4b97-85f6-44a4b405c130" (UID: "f711cf80-bfdf-4b97-85f6-44a4b405c130"). InnerVolumeSpecName "kube-api-access-tqvng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:10.933796 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.933773 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg" pod "aac280a2-54ea-4d95-9ec8-f175584bfc1a" (UID: "aac280a2-54ea-4d95-9ec8-f175584bfc1a"). InnerVolumeSpecName "kube-api-access-pzfqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:10.934168 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.934118 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle" pod "f711cf80-bfdf-4b97-85f6-44a4b405c130" (UID: "f711cf80-bfdf-4b97-85f6-44a4b405c130"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:10.934793 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.934769 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util" pod "aac280a2-54ea-4d95-9ec8-f175584bfc1a" (UID: "aac280a2-54ea-4d95-9ec8-f175584bfc1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:10.937106 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.937077 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util" pod "f711cf80-bfdf-4b97-85f6-44a4b405c130" (UID: "f711cf80-bfdf-4b97-85f6-44a4b405c130"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:10.989630 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:10.988220 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" podStartSLOduration=3.546700465 podStartE2EDuration="35.988201991s" totalImagesPullingTime="32.441501526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:10.987899385 +0000 UTC m=+359.485294147" watchObservedRunningTime="2026-11-04 05:55:10.988201991 +0000 UTC m=+359.485596755" Nov 04 05:55:11.029373 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029333 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzfqg\" (UniqueName: \"kubernetes.io/projected/aac280a2-54ea-4d95-9ec8-f175584bfc1a-kube-api-access-pzfqg\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.029373 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029374 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.029373 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029384 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.029660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029394 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aac280a2-54ea-4d95-9ec8-f175584bfc1a-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.029660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029403 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f711cf80-bfdf-4b97-85f6-44a4b405c130-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.029660 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.029414 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvng\" (UniqueName: \"kubernetes.io/projected/f711cf80-bfdf-4b97-85f6-44a4b405c130-kube-api-access-tqvng\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:11.642876 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.642842 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" event={"ID":"f711cf80-bfdf-4b97-85f6-44a4b405c130","Type":"ContainerDied","Data":"8704302a2e7626ccc52d2afa28dbe3b96d2e823f2f1eebb67ebc9433c60e6630"} Nov 04 05:55:11.643559 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.643536 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8704302a2e7626ccc52d2afa28dbe3b96d2e823f2f1eebb67ebc9433c60e6630" Nov 04 05:55:11.643800 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.643781 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7147hh6" Nov 04 05:55:11.649541 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.649511 4932 generic.go:356] "Generic (PLEG): container finished" podID="379b4075-baa7-41c9-8573-8102e72ec788" containerID="ee03044dbf76bde6c5be8a0836af8d312b5046892b53bc43746428f2a32fe294" exitCode=0 Nov 04 05:55:11.649642 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.649592 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerDied","Data":"ee03044dbf76bde6c5be8a0836af8d312b5046892b53bc43746428f2a32fe294"} Nov 04 05:55:11.655625 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.655166 4932 generic.go:356] "Generic (PLEG): container finished" podID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerID="6651d1e32c8b94cd7c621050e72298e6596c4212abed9fc2d5803d7c35b42199" exitCode=0 Nov 04 05:55:11.655625 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.655329 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerDied","Data":"6651d1e32c8b94cd7c621050e72298e6596c4212abed9fc2d5803d7c35b42199"} Nov 04 05:55:11.661335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.661315 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" Nov 04 05:55:11.662526 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.661847 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644hctsg" event={"ID":"aac280a2-54ea-4d95-9ec8-f175584bfc1a","Type":"ContainerDied","Data":"a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0"} Nov 04 05:55:11.662526 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.661882 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5ab1de4a3bd89cf6fad5fa65d2804fc3c1034e20bf83e3a97e375bae9df36e0" Nov 04 05:55:11.874070 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.874044 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:55:11.875529 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.875502 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938498 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\") pod \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938550 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\") pod \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938596 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\") pod \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938643 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\") pod \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938703 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\" (UniqueName: \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\") pod \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\" (UID: \"a180cab4-8e1b-4020-ad2b-ba914e4fa26c\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938752 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.938762 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\" (UniqueName: \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\") pod \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\" (UID: \"9428e4dd-0f41-4fe4-8849-b7382b99b0a0\") " Nov 04 05:55:11.941141 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.939570 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle" pod "a180cab4-8e1b-4020-ad2b-ba914e4fa26c" (UID: "a180cab4-8e1b-4020-ad2b-ba914e4fa26c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:11.941940 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.941913 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle" pod "9428e4dd-0f41-4fe4-8849-b7382b99b0a0" (UID: "9428e4dd-0f41-4fe4-8849-b7382b99b0a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:11.944142 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.944096 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9" pod "a180cab4-8e1b-4020-ad2b-ba914e4fa26c" (UID: "a180cab4-8e1b-4020-ad2b-ba914e4fa26c"). InnerVolumeSpecName "kube-api-access-bwst9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:11.945479 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.945442 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util" pod "a180cab4-8e1b-4020-ad2b-ba914e4fa26c" (UID: "a180cab4-8e1b-4020-ad2b-ba914e4fa26c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:11.947658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.947632 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h" pod "9428e4dd-0f41-4fe4-8849-b7382b99b0a0" (UID: "9428e4dd-0f41-4fe4-8849-b7382b99b0a0"). InnerVolumeSpecName "kube-api-access-d9h5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:11.948395 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.948372 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util" pod "9428e4dd-0f41-4fe4-8849-b7382b99b0a0" (UID: "9428e4dd-0f41-4fe4-8849-b7382b99b0a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:11.952161 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:11.952137 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:55:12.040268 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040232 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\") pod \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " Nov 04 05:55:12.040436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040303 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\") pod \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " Nov 04 05:55:12.040436 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040378 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\") pod \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " Nov 04 05:55:12.040551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040432 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\") pod \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " Nov 04 05:55:12.040551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040472 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\" (UniqueName: \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\") pod \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\" (UID: \"fb0098c9-9fdf-4f2f-816d-7f9998bf692e\") " Nov 04 05:55:12.040551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040538 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\" (UniqueName: \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\") pod \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\" (UID: \"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff\") " Nov 04 05:55:12.040854 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040832 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.040915 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040860 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.040915 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040876 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwst9\" (UniqueName: \"kubernetes.io/projected/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-kube-api-access-bwst9\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.040915 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040890 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9h5h\" (UniqueName: \"kubernetes.io/projected/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-kube-api-access-d9h5h\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.040915 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040897 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle" pod "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" (UID: "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.041047 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040906 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a180cab4-8e1b-4020-ad2b-ba914e4fa26c-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.041047 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.040945 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9428e4dd-0f41-4fe4-8849-b7382b99b0a0-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.042944 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.042913 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle" pod "fb0098c9-9fdf-4f2f-816d-7f9998bf692e" (UID: "fb0098c9-9fdf-4f2f-816d-7f9998bf692e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.043045 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.043029 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z" pod "fb0098c9-9fdf-4f2f-816d-7f9998bf692e" (UID: "fb0098c9-9fdf-4f2f-816d-7f9998bf692e"). InnerVolumeSpecName "kube-api-access-8c52z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:12.043275 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.043252 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh" pod "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" (UID: "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff"). InnerVolumeSpecName "kube-api-access-djjmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:12.047409 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.047380 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util" pod "fb0098c9-9fdf-4f2f-816d-7f9998bf692e" (UID: "fb0098c9-9fdf-4f2f-816d-7f9998bf692e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.048759 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.048736 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util" pod "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" (UID: "1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.142029 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.141992 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.142029 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.142027 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.142250 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.142041 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.142250 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.142056 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c52z\" (UniqueName: \"kubernetes.io/projected/fb0098c9-9fdf-4f2f-816d-7f9998bf692e-kube-api-access-8c52z\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.142250 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.142070 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djjmh\" (UniqueName: \"kubernetes.io/projected/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-kube-api-access-djjmh\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.142250 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.142084 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:12.669879 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.669786 4932 generic.go:356] "Generic (PLEG): container finished" podID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerID="a68f784af11f63bcde97b18dcd58cdb07f92cf80585cfa3009a6c6eb13759c72" exitCode=0 Nov 04 05:55:12.670309 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.669880 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" event={"ID":"c2b5fd20-a39a-436e-b618-c29cbd406d8e","Type":"ContainerDied","Data":"a68f784af11f63bcde97b18dcd58cdb07f92cf80585cfa3009a6c6eb13759c72"} Nov 04 05:55:12.672520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.672491 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" event={"ID":"a180cab4-8e1b-4020-ad2b-ba914e4fa26c","Type":"ContainerDied","Data":"67825d252b4d5bbacfd7acb0dab91a34371b5a323ab7d6f6bada49414b54418c"} Nov 04 05:55:12.672520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.672515 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsz2k" Nov 04 05:55:12.672704 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.672537 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67825d252b4d5bbacfd7acb0dab91a34371b5a323ab7d6f6bada49414b54418c" Nov 04 05:55:12.677085 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.677058 4932 generic.go:356] "Generic (PLEG): container finished" podID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerID="e91423c1e6fc698bcfbc5919260a55ff2793cd708967158a15525eabac149288" exitCode=0 Nov 04 05:55:12.677213 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.677140 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" event={"ID":"b0b92048-8d21-42ce-a25e-8fa5480c1bb3","Type":"ContainerDied","Data":"e91423c1e6fc698bcfbc5919260a55ff2793cd708967158a15525eabac149288"} Nov 04 05:55:12.679604 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.679581 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" event={"ID":"1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff","Type":"ContainerDied","Data":"f8e6b70b0e4d0842e1e56409e39dbc4c77d3c4d410cb32871941a9c0130dd79d"} Nov 04 05:55:12.679737 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.679626 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chbj6p" Nov 04 05:55:12.679737 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.679628 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8e6b70b0e4d0842e1e56409e39dbc4c77d3c4d410cb32871941a9c0130dd79d" Nov 04 05:55:12.682414 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.682391 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" Nov 04 05:55:12.682521 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.682422 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bhxp8" event={"ID":"fb0098c9-9fdf-4f2f-816d-7f9998bf692e","Type":"ContainerDied","Data":"4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760"} Nov 04 05:55:12.682521 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.682454 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b40d469046c3251907a810ce673c313cb171d936d5400f734e156f322267760" Nov 04 05:55:12.691896 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.691869 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" event={"ID":"9428e4dd-0f41-4fe4-8849-b7382b99b0a0","Type":"ContainerDied","Data":"e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d"} Nov 04 05:55:12.692011 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.691912 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1a62617c6b69ed9fd37c1eaea36f9276d977711cbd340d19b12fc3ec03d6f3d" Nov 04 05:55:12.692319 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.692259 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c628ftj" Nov 04 05:55:12.872627 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.872604 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:55:12.876530 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.876510 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:55:12.950189 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950165 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\") pod \"379b4075-baa7-41c9-8573-8102e72ec788\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " Nov 04 05:55:12.950300 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950203 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\") pod \"379b4075-baa7-41c9-8573-8102e72ec788\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " Nov 04 05:55:12.950300 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950248 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\") pod \"8685a98a-a8a8-47f4-b90e-32e381c24310\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " Nov 04 05:55:12.950402 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950321 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\" (UniqueName: \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\") pod \"379b4075-baa7-41c9-8573-8102e72ec788\" (UID: \"379b4075-baa7-41c9-8573-8102e72ec788\") " Nov 04 05:55:12.950456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950399 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\" (UniqueName: \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\") pod \"8685a98a-a8a8-47f4-b90e-32e381c24310\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " Nov 04 05:55:12.950456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.950432 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\") pod \"8685a98a-a8a8-47f4-b90e-32e381c24310\" (UID: \"8685a98a-a8a8-47f4-b90e-32e381c24310\") " Nov 04 05:55:12.951260 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.951216 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle" pod "379b4075-baa7-41c9-8573-8102e72ec788" (UID: "379b4075-baa7-41c9-8573-8102e72ec788"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.951365 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.951311 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle" pod "8685a98a-a8a8-47f4-b90e-32e381c24310" (UID: "8685a98a-a8a8-47f4-b90e-32e381c24310"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.952654 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.952629 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf" pod "379b4075-baa7-41c9-8573-8102e72ec788" (UID: "379b4075-baa7-41c9-8573-8102e72ec788"). InnerVolumeSpecName "kube-api-access-x6gvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:12.952975 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.952953 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5" pod "8685a98a-a8a8-47f4-b90e-32e381c24310" (UID: "8685a98a-a8a8-47f4-b90e-32e381c24310"). InnerVolumeSpecName "kube-api-access-9bhx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:12.957490 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.957463 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util" pod "379b4075-baa7-41c9-8573-8102e72ec788" (UID: "379b4075-baa7-41c9-8573-8102e72ec788"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:12.958440 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:12.958417 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util" pod "8685a98a-a8a8-47f4-b90e-32e381c24310" (UID: "8685a98a-a8a8-47f4-b90e-32e381c24310"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:13.051387 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051356 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.051387 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051384 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379b4075-baa7-41c9-8573-8102e72ec788-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.051387 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051394 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.051588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051404 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6gvf\" (UniqueName: \"kubernetes.io/projected/379b4075-baa7-41c9-8573-8102e72ec788-kube-api-access-x6gvf\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.051588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051413 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bhx5\" (UniqueName: \"kubernetes.io/projected/8685a98a-a8a8-47f4-b90e-32e381c24310-kube-api-access-9bhx5\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.051588 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.051422 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8685a98a-a8a8-47f4-b90e-32e381c24310-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:13.698465 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.698433 4932 generic.go:356] "Generic (PLEG): container finished" podID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerID="0500e1794795f76b9b5849ceed8fb1571a6ec5bae9039a448091978911306f6c" exitCode=0 Nov 04 05:55:13.698896 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.698518 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerDied","Data":"0500e1794795f76b9b5849ceed8fb1571a6ec5bae9039a448091978911306f6c"} Nov 04 05:55:13.701248 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.701224 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" event={"ID":"379b4075-baa7-41c9-8573-8102e72ec788","Type":"ContainerDied","Data":"6602350efc560cb2e40b079180beaaba7b6f42ec30696a646008ac8e164daeb6"} Nov 04 05:55:13.701369 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.701291 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6602350efc560cb2e40b079180beaaba7b6f42ec30696a646008ac8e164daeb6" Nov 04 05:55:13.701369 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.701233 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvngck" Nov 04 05:55:13.703339 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.703309 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" Nov 04 05:55:13.703437 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.703342 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2zk2t" event={"ID":"8685a98a-a8a8-47f4-b90e-32e381c24310","Type":"ContainerDied","Data":"5866cfe07074ea8e890260c15efa27d6eb117d2a7a3d29880df27d2bfe6aea49"} Nov 04 05:55:13.703437 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.703380 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5866cfe07074ea8e890260c15efa27d6eb117d2a7a3d29880df27d2bfe6aea49" Nov 04 05:55:13.705770 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.705747 4932 generic.go:356] "Generic (PLEG): container finished" podID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerID="eb8394687085100d681d1ebe140d3236e48330f723a62f748017fc685b01da85" exitCode=0 Nov 04 05:55:13.705865 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.705769 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" event={"ID":"e0d2c740-77e2-4127-a78a-6a7588bb1d10","Type":"ContainerDied","Data":"eb8394687085100d681d1ebe140d3236e48330f723a62f748017fc685b01da85"} Nov 04 05:55:13.853521 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.853500 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:55:13.871632 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.871609 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:55:13.958003 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.957975 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\") pod \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " Nov 04 05:55:13.958135 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958053 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\" (UniqueName: \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\") pod \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " Nov 04 05:55:13.958135 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958089 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\") pod \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " Nov 04 05:55:13.958135 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958115 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\") pod \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\" (UID: \"c2b5fd20-a39a-436e-b618-c29cbd406d8e\") " Nov 04 05:55:13.958135 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958132 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\" (UniqueName: \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\") pod \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " Nov 04 05:55:13.958351 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958172 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\") pod \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\" (UID: \"b0b92048-8d21-42ce-a25e-8fa5480c1bb3\") " Nov 04 05:55:13.958623 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958590 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle" pod "c2b5fd20-a39a-436e-b618-c29cbd406d8e" (UID: "c2b5fd20-a39a-436e-b618-c29cbd406d8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:13.958810 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.958772 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle" pod "b0b92048-8d21-42ce-a25e-8fa5480c1bb3" (UID: "b0b92048-8d21-42ce-a25e-8fa5480c1bb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:13.960623 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.960600 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk" pod "b0b92048-8d21-42ce-a25e-8fa5480c1bb3" (UID: "b0b92048-8d21-42ce-a25e-8fa5480c1bb3"). InnerVolumeSpecName "kube-api-access-nn7rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:13.960682 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.960620 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg" pod "c2b5fd20-a39a-436e-b618-c29cbd406d8e" (UID: "c2b5fd20-a39a-436e-b618-c29cbd406d8e"). InnerVolumeSpecName "kube-api-access-mg9hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:13.964361 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.964339 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util" pod "b0b92048-8d21-42ce-a25e-8fa5480c1bb3" (UID: "b0b92048-8d21-42ce-a25e-8fa5480c1bb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:13.964659 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:13.964637 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util" pod "c2b5fd20-a39a-436e-b618-c29cbd406d8e" (UID: "c2b5fd20-a39a-436e-b618-c29cbd406d8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:14.059252 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059213 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg9hg\" (UniqueName: \"kubernetes.io/projected/c2b5fd20-a39a-436e-b618-c29cbd406d8e-kube-api-access-mg9hg\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.059252 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059248 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.059252 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059258 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.059553 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059266 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn7rk\" (UniqueName: \"kubernetes.io/projected/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-kube-api-access-nn7rk\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.059553 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059275 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b92048-8d21-42ce-a25e-8fa5480c1bb3-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.059553 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.059284 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b5fd20-a39a-436e-b618-c29cbd406d8e-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:14.712320 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.712277 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" event={"ID":"c2b5fd20-a39a-436e-b618-c29cbd406d8e","Type":"ContainerDied","Data":"11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a"} Nov 04 05:55:14.712776 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.712319 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chrmcm" Nov 04 05:55:14.712776 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.712334 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11b62b514381c7d2fd54651925c79dd990e33d69a536139f63865f27577d6a7a" Nov 04 05:55:14.714255 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.714231 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" Nov 04 05:55:14.714360 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.714237 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ntpn4" event={"ID":"b0b92048-8d21-42ce-a25e-8fa5480c1bb3","Type":"ContainerDied","Data":"07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a"} Nov 04 05:55:14.714360 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.714291 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07cdfe09f68999f24da727c5eb0d64b3aa5596700d1cb01066f9b6fe62be715a" Nov 04 05:55:14.843935 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.843912 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:55:14.870419 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.870394 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:55:14.970122 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970095 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\") pod \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " Nov 04 05:55:14.970291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970144 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\") pod \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " Nov 04 05:55:14.970291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970173 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\" (UniqueName: \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\") pod \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " Nov 04 05:55:14.970291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970195 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\") pod \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " Nov 04 05:55:14.970291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970235 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\") pod \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\" (UID: \"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a\") " Nov 04 05:55:14.970291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970281 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\" (UniqueName: \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\") pod \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\" (UID: \"e0d2c740-77e2-4127-a78a-6a7588bb1d10\") " Nov 04 05:55:14.970968 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.970937 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle" pod "e0d2c740-77e2-4127-a78a-6a7588bb1d10" (UID: "e0d2c740-77e2-4127-a78a-6a7588bb1d10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:14.975174 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.975134 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle" pod "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" (UID: "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:14.977887 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.977865 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc" pod "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" (UID: "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a"). InnerVolumeSpecName "kube-api-access-cvsfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:14.977951 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.977874 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps" pod "e0d2c740-77e2-4127-a78a-6a7588bb1d10" (UID: "e0d2c740-77e2-4127-a78a-6a7588bb1d10"). InnerVolumeSpecName "kube-api-access-cnzps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:55:14.978470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.978450 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util" pod "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" (UID: "9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:14.978758 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:14.978722 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util" pod "e0d2c740-77e2-4127-a78a-6a7588bb1d10" (UID: "e0d2c740-77e2-4127-a78a-6a7588bb1d10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:55:15.071550 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071525 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvsfc\" (UniqueName: \"kubernetes.io/projected/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-kube-api-access-cvsfc\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.071550 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071550 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.071763 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071559 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.071763 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071567 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnzps\" (UniqueName: \"kubernetes.io/projected/e0d2c740-77e2-4127-a78a-6a7588bb1d10-kube-api-access-cnzps\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.071763 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071575 4932 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0d2c740-77e2-4127-a78a-6a7588bb1d10-util\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.071763 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.071583 4932 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:55:15.720408 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.720385 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" Nov 04 05:55:15.720777 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.720411 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cpqzgp" event={"ID":"9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a","Type":"ContainerDied","Data":"6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50"} Nov 04 05:55:15.720777 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.720461 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6670b065c46b3bd52a837364d5abd482cc2f0cd80beeb4f11bea676c847dbf50" Nov 04 05:55:15.722566 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.722544 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" event={"ID":"e0d2c740-77e2-4127-a78a-6a7588bb1d10","Type":"ContainerDied","Data":"45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025"} Nov 04 05:55:15.722658 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.722584 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45a091e11050a84ad10c9a45d7ac1fa353af284b95b59f867c21d85445847025" Nov 04 05:55:15.722803 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:15.722788 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7zbd7" Nov 04 05:55:17.368147 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:55:17.368113 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:55:27.280921 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.280885 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs"] Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281239 4932 cpu_manager.go:414] "containerMap: removing container" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="util" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281251 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="util" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281262 4932 cpu_manager.go:414] "containerMap: removing container" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="util" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281268 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="util" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281277 4932 cpu_manager.go:414] "containerMap: removing container" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="pull" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281282 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="pull" Nov 04 05:55:27.281291 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281292 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281298 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281307 4932 cpu_manager.go:414] "containerMap: removing container" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281311 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281321 4932 cpu_manager.go:414] "containerMap: removing container" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281326 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281332 4932 cpu_manager.go:414] "containerMap: removing container" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281336 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281345 4932 cpu_manager.go:414] "containerMap: removing container" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281349 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281355 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281361 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281366 4932 cpu_manager.go:414] "containerMap: removing container" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281371 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281376 4932 cpu_manager.go:414] "containerMap: removing container" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281381 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281387 4932 cpu_manager.go:414] "containerMap: removing container" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281391 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281401 4932 cpu_manager.go:414] "containerMap: removing container" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281405 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281412 4932 cpu_manager.go:414] "containerMap: removing container" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281416 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281426 4932 cpu_manager.go:414] "containerMap: removing container" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281430 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281439 4932 cpu_manager.go:414] "containerMap: removing container" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281443 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281456 4932 cpu_manager.go:414] "containerMap: removing container" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281461 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281466 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281471 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281476 4932 cpu_manager.go:414] "containerMap: removing container" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281481 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281486 4932 cpu_manager.go:414] "containerMap: removing container" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281490 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281496 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281500 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281506 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281510 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="extract" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281518 4932 cpu_manager.go:414] "containerMap: removing container" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281522 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="util" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281528 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="pull" Nov 04 05:55:27.281513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281533 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281538 4932 cpu_manager.go:414] "containerMap: removing container" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281543 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281550 4932 cpu_manager.go:414] "containerMap: removing container" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281554 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281562 4932 cpu_manager.go:414] "containerMap: removing container" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281566 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281573 4932 cpu_manager.go:414] "containerMap: removing container" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281577 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281585 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281589 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281594 4932 cpu_manager.go:414] "containerMap: removing container" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281598 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="pull" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281605 4932 cpu_manager.go:414] "containerMap: removing container" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281609 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281621 4932 cpu_manager.go:414] "containerMap: removing container" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281625 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281632 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281636 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281660 4932 cpu_manager.go:414] "containerMap: removing container" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281668 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="util" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281676 4932 cpu_manager.go:414] "containerMap: removing container" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281681 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281688 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281692 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281757 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c9f69a8-69d7-4e6c-bd9e-220bcc6bec9a" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281766 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="aac280a2-54ea-4d95-9ec8-f175584bfc1a" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281772 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="a180cab4-8e1b-4020-ad2b-ba914e4fa26c" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281777 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="f711cf80-bfdf-4b97-85f6-44a4b405c130" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281782 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="9428e4dd-0f41-4fe4-8849-b7382b99b0a0" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281788 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0b92048-8d21-42ce-a25e-8fa5480c1bb3" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281793 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f2239c5-f9c0-46ab-9f64-cb3ed08f8eff" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281800 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb0098c9-9fdf-4f2f-816d-7f9998bf692e" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281804 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="8685a98a-a8a8-47f4-b90e-32e381c24310" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281812 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2b5fd20-a39a-436e-b618-c29cbd406d8e" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281816 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0d2c740-77e2-4127-a78a-6a7588bb1d10" containerName="extract" Nov 04 05:55:27.282791 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.281822 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="379b4075-baa7-41c9-8573-8102e72ec788" containerName="extract" Nov 04 05:55:27.284905 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.284890 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.341643 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.341617 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 05:55:27.395046 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.394947 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-8fcjx\"" Nov 04 05:55:27.395046 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.394972 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 05:55:27.395046 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.394956 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 05:55:27.395046 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.394992 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 05:55:27.395526 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.395093 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 05:55:27.397706 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.397685 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs"] Nov 04 05:55:27.467088 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467051 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.467285 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467112 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.467285 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467261 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.467407 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467328 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.467407 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467394 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.467513 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.467440 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vv8r\" (UniqueName: \"kubernetes.io/projected/9f35b6e0-e560-409d-b554-f5919391c8bf-kube-api-access-2vv8r\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568102 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568014 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568102 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568067 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vv8r\" (UniqueName: \"kubernetes.io/projected/9f35b6e0-e560-409d-b554-f5919391c8bf-kube-api-access-2vv8r\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568102 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568099 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568377 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568155 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568377 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568288 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568377 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568364 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.568626 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.568606 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.570449 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.570419 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.570627 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.570597 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f35b6e0-e560-409d-b554-f5919391c8bf-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.570710 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.570692 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.570931 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.570910 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f35b6e0-e560-409d-b554-f5919391c8bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.633039 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.633010 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vv8r\" (UniqueName: \"kubernetes.io/projected/9f35b6e0-e560-409d-b554-f5919391c8bf-kube-api-access-2vv8r\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-sqqqs\" (UID: \"9f35b6e0-e560-409d-b554-f5919391c8bf\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:27.899230 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:27.899146 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:28.459578 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:28.459548 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs"] Nov 04 05:55:28.460962 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:28.460932 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f35b6e0_e560_409d_b554_f5919391c8bf.slice/crio-df349904399e4ee98fa18bd9d5903c8717e9a08998638f3ba767a57b9d85b591 WatchSource:0}: Error finding container df349904399e4ee98fa18bd9d5903c8717e9a08998638f3ba767a57b9d85b591: Status 404 returned error can't find the container with id df349904399e4ee98fa18bd9d5903c8717e9a08998638f3ba767a57b9d85b591 Nov 04 05:55:28.781498 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:28.781461 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" event={"ID":"9f35b6e0-e560-409d-b554-f5919391c8bf","Type":"ContainerStarted","Data":"df349904399e4ee98fa18bd9d5903c8717e9a08998638f3ba767a57b9d85b591"} Nov 04 05:55:30.290568 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.290531 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:55:30.295644 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.295617 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.352973 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.352941 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:55:30.394320 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.394292 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srzr9\" (UniqueName: \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.394487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.394330 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.403546 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.403514 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 05:55:30.403546 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.403529 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cvw27\"" Nov 04 05:55:30.403811 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.403591 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 05:55:30.494961 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.494927 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srzr9\" (UniqueName: \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.495131 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.494981 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.495389 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.495365 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.561323 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.561245 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srzr9\" (UniqueName: \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-fhb9b\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:30.611267 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:30.611236 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:31.107032 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:31.106323 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:55:31.108787 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:31.108753 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c15010_e626_4089_9150_fc5e373331f6.slice/crio-7499d3c6ce4c0aae2ac70d5ea85d5f8934da479b73597a12e0d55d7f852c1afe WatchSource:0}: Error finding container 7499d3c6ce4c0aae2ac70d5ea85d5f8934da479b73597a12e0d55d7f852c1afe: Status 404 returned error can't find the container with id 7499d3c6ce4c0aae2ac70d5ea85d5f8934da479b73597a12e0d55d7f852c1afe Nov 04 05:55:31.799197 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:31.799161 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" event={"ID":"9f35b6e0-e560-409d-b554-f5919391c8bf","Type":"ContainerStarted","Data":"da8a4645c532775520612fbbecd9ea3a6726e62d23c93efd6dc8e903e9ce0f60"} Nov 04 05:55:31.800717 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:31.800690 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" event={"ID":"15c15010-e626-4089-9150-fc5e373331f6","Type":"ContainerStarted","Data":"7499d3c6ce4c0aae2ac70d5ea85d5f8934da479b73597a12e0d55d7f852c1afe"} Nov 04 05:55:32.807349 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:32.807317 4932 generic.go:356] "Generic (PLEG): container finished" podID="9f35b6e0-e560-409d-b554-f5919391c8bf" containerID="da8a4645c532775520612fbbecd9ea3a6726e62d23c93efd6dc8e903e9ce0f60" exitCode=0 Nov 04 05:55:32.807822 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:32.807365 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" event={"ID":"9f35b6e0-e560-409d-b554-f5919391c8bf","Type":"ContainerDied","Data":"da8a4645c532775520612fbbecd9ea3a6726e62d23c93efd6dc8e903e9ce0f60"} Nov 04 05:55:33.815869 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:33.815831 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" event={"ID":"9f35b6e0-e560-409d-b554-f5919391c8bf","Type":"ContainerStarted","Data":"b08cf27e4eb80757f8c2d166b26422348e4101025a06f6380dbe7875c504e07e"} Nov 04 05:55:33.816474 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:33.815979 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:34.080070 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:34.080009 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" podStartSLOduration=2.433702417 podStartE2EDuration="7.079985949s" totalImagesPullingTime="4.094937441s" totalInitContainerRuntime="551.346091ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:34.032954683 +0000 UTC m=+382.530349447" watchObservedRunningTime="2026-11-04 05:55:34.079985949 +0000 UTC m=+382.577380712" Nov 04 05:55:35.401855 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.401819 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x"] Nov 04 05:55:35.442035 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.442008 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:35.536751 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.536693 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6jcj\" (UniqueName: \"kubernetes.io/projected/0130cf42-d37d-4db7-96f4-bf240c95c15c-kube-api-access-v6jcj\") pod \"authorino-operator-7b7bb4bc77-fbx8x\" (UID: \"0130cf42-d37d-4db7-96f4-bf240c95c15c\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:35.551914 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.551892 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fd9m6\"" Nov 04 05:55:35.554312 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.554287 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x"] Nov 04 05:55:35.638092 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.638065 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6jcj\" (UniqueName: \"kubernetes.io/projected/0130cf42-d37d-4db7-96f4-bf240c95c15c-kube-api-access-v6jcj\") pod \"authorino-operator-7b7bb4bc77-fbx8x\" (UID: \"0130cf42-d37d-4db7-96f4-bf240c95c15c\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:35.713146 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.713072 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6jcj\" (UniqueName: \"kubernetes.io/projected/0130cf42-d37d-4db7-96f4-bf240c95c15c-kube-api-access-v6jcj\") pod \"authorino-operator-7b7bb4bc77-fbx8x\" (UID: \"0130cf42-d37d-4db7-96f4-bf240c95c15c\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:35.774093 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:35.774048 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:36.160359 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:36.160337 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x"] Nov 04 05:55:36.161232 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:36.161200 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0130cf42_d37d_4db7_96f4_bf240c95c15c.slice/crio-abf5067039ef2432396d5683fe8baa7b80f4f2a35d4146d354a1857e06781b71 WatchSource:0}: Error finding container abf5067039ef2432396d5683fe8baa7b80f4f2a35d4146d354a1857e06781b71: Status 404 returned error can't find the container with id abf5067039ef2432396d5683fe8baa7b80f4f2a35d4146d354a1857e06781b71 Nov 04 05:55:36.833492 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:36.833454 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" event={"ID":"15c15010-e626-4089-9150-fc5e373331f6","Type":"ContainerStarted","Data":"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702"} Nov 04 05:55:36.833974 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:36.833617 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:36.834822 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:36.834792 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" event={"ID":"0130cf42-d37d-4db7-96f4-bf240c95c15c","Type":"ContainerStarted","Data":"abf5067039ef2432396d5683fe8baa7b80f4f2a35d4146d354a1857e06781b71"} Nov 04 05:55:37.078027 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:37.077974 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" podStartSLOduration=1.926829613 podStartE2EDuration="7.077961109s" totalImagesPullingTime="5.151131496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:37.023225578 +0000 UTC m=+385.520620344" watchObservedRunningTime="2026-11-04 05:55:37.077961109 +0000 UTC m=+385.575355862" Nov 04 05:55:38.758039 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.758000 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh"] Nov 04 05:55:38.761628 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.761600 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.770326 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.770299 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4350902-6dc5-4536-a6bb-f3ea2e712e16-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.770451 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.770340 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89lrr\" (UniqueName: \"kubernetes.io/projected/a4350902-6dc5-4536-a6bb-f3ea2e712e16-kube-api-access-89lrr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.816294 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.816266 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh"] Nov 04 05:55:38.867030 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.866998 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 04 05:55:38.867226 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.867197 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qngp5\"" Nov 04 05:55:38.867295 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.867271 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:55:38.871706 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.871679 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89lrr\" (UniqueName: \"kubernetes.io/projected/a4350902-6dc5-4536-a6bb-f3ea2e712e16-kube-api-access-89lrr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.871846 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.871805 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4350902-6dc5-4536-a6bb-f3ea2e712e16-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.872210 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.872186 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4350902-6dc5-4536-a6bb-f3ea2e712e16-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:38.942908 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:38.942807 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89lrr\" (UniqueName: \"kubernetes.io/projected/a4350902-6dc5-4536-a6bb-f3ea2e712e16-kube-api-access-89lrr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh\" (UID: \"a4350902-6dc5-4536-a6bb-f3ea2e712e16\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:39.076058 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.075993 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" Nov 04 05:55:39.137491 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.137466 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d"] Nov 04 05:55:39.142215 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.142195 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:39.175378 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.175341 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxg2p\" (UniqueName: \"kubernetes.io/projected/dbb95c0c-0262-48b2-af9b-c61251126c21-kube-api-access-rxg2p\") pod \"dns-operator-controller-manager-8557cbdb84-km68d\" (UID: \"dbb95c0c-0262-48b2-af9b-c61251126c21\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:39.199931 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.199504 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Nov 04 05:55:39.199931 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.199608 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n5ggk\"" Nov 04 05:55:39.201890 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.201863 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d"] Nov 04 05:55:39.276509 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.276478 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxg2p\" (UniqueName: \"kubernetes.io/projected/dbb95c0c-0262-48b2-af9b-c61251126c21-kube-api-access-rxg2p\") pod \"dns-operator-controller-manager-8557cbdb84-km68d\" (UID: \"dbb95c0c-0262-48b2-af9b-c61251126c21\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:39.341416 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.341351 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxg2p\" (UniqueName: \"kubernetes.io/projected/dbb95c0c-0262-48b2-af9b-c61251126c21-kube-api-access-rxg2p\") pod \"dns-operator-controller-manager-8557cbdb84-km68d\" (UID: \"dbb95c0c-0262-48b2-af9b-c61251126c21\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:39.528552 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.528519 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:39.549229 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:39.549200 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4350902_6dc5_4536_a6bb_f3ea2e712e16.slice/crio-6c3a12c5c72100aa3b679646c2ab026455b1fa9e60cde428edb2a320a5806044 WatchSource:0}: Error finding container 6c3a12c5c72100aa3b679646c2ab026455b1fa9e60cde428edb2a320a5806044: Status 404 returned error can't find the container with id 6c3a12c5c72100aa3b679646c2ab026455b1fa9e60cde428edb2a320a5806044 Nov 04 05:55:39.549456 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.549431 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh"] Nov 04 05:55:39.850545 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.850507 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" event={"ID":"0130cf42-d37d-4db7-96f4-bf240c95c15c","Type":"ContainerStarted","Data":"dd19b8611795725a1bc00267cb2304cc3ef92e64b29ebb15a412118f196d9c36"} Nov 04 05:55:39.850997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.850579 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:39.852044 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.852022 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" event={"ID":"a4350902-6dc5-4536-a6bb-f3ea2e712e16","Type":"ContainerStarted","Data":"6c3a12c5c72100aa3b679646c2ab026455b1fa9e60cde428edb2a320a5806044"} Nov 04 05:55:39.918777 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.918752 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d"] Nov 04 05:55:39.919943 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:39.919916 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb95c0c_0262_48b2_af9b_c61251126c21.slice/crio-c2ce4ba99169e9743fc9b0ff458b113f7efa372dbd18c1add12e470ad09e76a9 WatchSource:0}: Error finding container c2ce4ba99169e9743fc9b0ff458b113f7efa372dbd18c1add12e470ad09e76a9: Status 404 returned error can't find the container with id c2ce4ba99169e9743fc9b0ff458b113f7efa372dbd18c1add12e470ad09e76a9 Nov 04 05:55:39.978550 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:39.978497 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" podStartSLOduration=2.017728197 podStartE2EDuration="4.97848472s" totalImagesPullingTime="2.960756523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:39.977454648 +0000 UTC m=+388.474849410" watchObservedRunningTime="2026-11-04 05:55:39.97848472 +0000 UTC m=+388.475879482" Nov 04 05:55:40.857839 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:40.857796 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" event={"ID":"dbb95c0c-0262-48b2-af9b-c61251126c21","Type":"ContainerStarted","Data":"c2ce4ba99169e9743fc9b0ff458b113f7efa372dbd18c1add12e470ad09e76a9"} Nov 04 05:55:42.870270 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:42.870229 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" event={"ID":"a4350902-6dc5-4536-a6bb-f3ea2e712e16","Type":"ContainerStarted","Data":"f1f8437961fc6974a8fa9bda5f7a158ed6fdfef27c32f9110f59005adf26b58e"} Nov 04 05:55:42.871991 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:42.871963 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" event={"ID":"dbb95c0c-0262-48b2-af9b-c61251126c21","Type":"ContainerStarted","Data":"34ee6ba910915e089dca1b21583d3c4cecdfcfdc28f62b616cf800fb56f2af30"} Nov 04 05:55:42.872115 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:42.872035 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:43.111708 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.111655 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntbjh" podStartSLOduration=2.275989792 podStartE2EDuration="5.111641247s" totalImagesPullingTime="2.835651455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:43.056820807 +0000 UTC m=+391.554215572" watchObservedRunningTime="2026-11-04 05:55:43.111641247 +0000 UTC m=+391.609036010" Nov 04 05:55:43.185686 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.185633 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" podStartSLOduration=1.484877537 podStartE2EDuration="4.185619986s" totalImagesPullingTime="2.700742449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:43.184225925 +0000 UTC m=+391.681620686" watchObservedRunningTime="2026-11-04 05:55:43.185619986 +0000 UTC m=+391.683014749" Nov 04 05:55:43.347795 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.347765 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5"] Nov 04 05:55:43.351185 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.351169 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:43.409671 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.409607 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gwclh\"" Nov 04 05:55:43.411885 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.411861 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5"] Nov 04 05:55:43.415930 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.415905 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4snsq\" (UniqueName: \"kubernetes.io/projected/a6f95f24-4dfa-44ef-a1c3-11c873fae729-kube-api-access-4snsq\") pod \"limitador-operator-controller-manager-5778bb4449-cfsb5\" (UID: \"a6f95f24-4dfa-44ef-a1c3-11c873fae729\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:43.516781 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.516747 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4snsq\" (UniqueName: \"kubernetes.io/projected/a6f95f24-4dfa-44ef-a1c3-11c873fae729-kube-api-access-4snsq\") pod \"limitador-operator-controller-manager-5778bb4449-cfsb5\" (UID: \"a6f95f24-4dfa-44ef-a1c3-11c873fae729\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:43.582758 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.582712 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4snsq\" (UniqueName: \"kubernetes.io/projected/a6f95f24-4dfa-44ef-a1c3-11c873fae729-kube-api-access-4snsq\") pod \"limitador-operator-controller-manager-5778bb4449-cfsb5\" (UID: \"a6f95f24-4dfa-44ef-a1c3-11c873fae729\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:43.663492 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:43.663410 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:44.041869 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:44.041842 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5"] Nov 04 05:55:44.042704 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:44.042679 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f95f24_4dfa_44ef_a1c3_11c873fae729.slice/crio-7b65c5975f853e0316770db43643541d5f1fc6a392073e5d8d4d06991013fcfa WatchSource:0}: Error finding container 7b65c5975f853e0316770db43643541d5f1fc6a392073e5d8d4d06991013fcfa: Status 404 returned error can't find the container with id 7b65c5975f853e0316770db43643541d5f1fc6a392073e5d8d4d06991013fcfa Nov 04 05:55:44.823056 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:44.823028 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-sqqqs" Nov 04 05:55:44.882519 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:44.882486 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" event={"ID":"a6f95f24-4dfa-44ef-a1c3-11c873fae729","Type":"ContainerStarted","Data":"7b65c5975f853e0316770db43643541d5f1fc6a392073e5d8d4d06991013fcfa"} Nov 04 05:55:46.897684 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:46.897651 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" event={"ID":"a6f95f24-4dfa-44ef-a1c3-11c873fae729","Type":"ContainerStarted","Data":"27bdc7634f3a4296b96299e108c78caa8e8e600b6a17eb2637cd8d96e323b78a"} Nov 04 05:55:46.898120 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:46.897790 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:55:47.024764 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:47.024699 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" podStartSLOduration=1.683430327 podStartE2EDuration="4.024685161s" totalImagesPullingTime="2.341254834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:47.023290326 +0000 UTC m=+395.520685089" watchObservedRunningTime="2026-11-04 05:55:47.024685161 +0000 UTC m=+395.522079924" Nov 04 05:55:47.369197 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:55:47.369156 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:55:47.841543 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:47.841513 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:55:48.618512 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.618475 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz"] Nov 04 05:55:48.622204 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.622181 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.664388 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.664360 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68d0c43-d9af-48c7-9b2d-08ed36453372-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.664551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.664395 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xcr7\" (UniqueName: \"kubernetes.io/projected/d68d0c43-d9af-48c7-9b2d-08ed36453372-kube-api-access-4xcr7\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.730108 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.730071 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz"] Nov 04 05:55:48.765706 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.765669 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68d0c43-d9af-48c7-9b2d-08ed36453372-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.765706 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.765707 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xcr7\" (UniqueName: \"kubernetes.io/projected/d68d0c43-d9af-48c7-9b2d-08ed36453372-kube-api-access-4xcr7\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.766153 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.766131 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68d0c43-d9af-48c7-9b2d-08ed36453372-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.833137 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.833100 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xcr7\" (UniqueName: \"kubernetes.io/projected/d68d0c43-d9af-48c7-9b2d-08ed36453372-kube-api-access-4xcr7\") pod \"kuadrant-operator-controller-manager-678d87766f-pmbzz\" (UID: \"d68d0c43-d9af-48c7-9b2d-08ed36453372\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:48.933889 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:48.933810 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:49.365483 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:49.365456 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz"] Nov 04 05:55:49.367289 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:55:49.367253 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68d0c43_d9af_48c7_9b2d_08ed36453372.slice/crio-ceac0d8be6dd738cf361d181816f18859705f2ced80daaf1c73d2ceb71c517b1 WatchSource:0}: Error finding container ceac0d8be6dd738cf361d181816f18859705f2ced80daaf1c73d2ceb71c517b1: Status 404 returned error can't find the container with id ceac0d8be6dd738cf361d181816f18859705f2ced80daaf1c73d2ceb71c517b1 Nov 04 05:55:49.914685 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:49.914650 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" event={"ID":"d68d0c43-d9af-48c7-9b2d-08ed36453372","Type":"ContainerStarted","Data":"41d70b046a7cef1402805758b9260f4cae262c5d868e4b874e36e07e1f06e4fb"} Nov 04 05:55:49.915094 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:49.914711 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" event={"ID":"d68d0c43-d9af-48c7-9b2d-08ed36453372","Type":"ContainerStarted","Data":"ceac0d8be6dd738cf361d181816f18859705f2ced80daaf1c73d2ceb71c517b1"} Nov 04 05:55:49.915094 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:49.914776 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:55:50.045860 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:50.045807 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" podStartSLOduration=2.045793603 podStartE2EDuration="2.045793603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:50.043853009 +0000 UTC m=+398.541247772" watchObservedRunningTime="2026-11-04 05:55:50.045793603 +0000 UTC m=+398.543188365" Nov 04 05:55:50.860328 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:50.860299 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbx8x" Nov 04 05:55:53.878881 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:53.878807 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-km68d" Nov 04 05:55:57.905066 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:55:57.905029 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-cfsb5" Nov 04 05:56:00.923891 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:00.923863 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-pmbzz" Nov 04 05:56:01.162832 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.162792 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:56:01.163057 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.163029 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" podUID="15c15010-e626-4089-9150-fc5e373331f6" containerName="manager" containerID="cri-o://6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702" gracePeriod=10 Nov 04 05:56:01.411470 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.411442 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:56:01.474263 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.474238 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\") pod \"15c15010-e626-4089-9150-fc5e373331f6\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " Nov 04 05:56:01.474420 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.474314 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\" (UniqueName: \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\") pod \"15c15010-e626-4089-9150-fc5e373331f6\" (UID: \"15c15010-e626-4089-9150-fc5e373331f6\") " Nov 04 05:56:01.474688 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.474664 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume" pod "15c15010-e626-4089-9150-fc5e373331f6" (UID: "15c15010-e626-4089-9150-fc5e373331f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:56:01.476352 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.476332 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9" pod "15c15010-e626-4089-9150-fc5e373331f6" (UID: "15c15010-e626-4089-9150-fc5e373331f6"). InnerVolumeSpecName "kube-api-access-srzr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:56:01.575528 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.575503 4932 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15c15010-e626-4089-9150-fc5e373331f6-extensions-socket-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:56:01.575528 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.575526 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srzr9\" (UniqueName: \"kubernetes.io/projected/15c15010-e626-4089-9150-fc5e373331f6-kube-api-access-srzr9\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:56:01.983102 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.983062 4932 generic.go:356] "Generic (PLEG): container finished" podID="15c15010-e626-4089-9150-fc5e373331f6" containerID="6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702" exitCode=0 Nov 04 05:56:01.983520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.983128 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" Nov 04 05:56:01.983520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.983142 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" event={"ID":"15c15010-e626-4089-9150-fc5e373331f6","Type":"ContainerDied","Data":"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702"} Nov 04 05:56:01.983520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.983218 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b" event={"ID":"15c15010-e626-4089-9150-fc5e373331f6","Type":"ContainerDied","Data":"7499d3c6ce4c0aae2ac70d5ea85d5f8934da479b73597a12e0d55d7f852c1afe"} Nov 04 05:56:01.983520 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.983240 4932 scope.go:122] "RemoveContainer" containerID="6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702" Nov 04 05:56:01.992288 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.992264 4932 scope.go:122] "RemoveContainer" containerID="6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702" Nov 04 05:56:01.992598 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:56:01.992579 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702\": container with ID starting with 6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702 not found: ID does not exist" containerID="6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702" Nov 04 05:56:01.992651 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:01.992608 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702"} err="failed to get container status \"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702\": rpc error: code = NotFound desc = could not find container \"6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702\": container with ID starting with 6b8e46de22ae45de715a7be0b461cfb249d5656edc7448729845df2012956702 not found: ID does not exist" Nov 04 05:56:02.174651 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:02.174615 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:56:02.228117 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:02.228080 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-fhb9b"] Nov 04 05:56:03.616216 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:03.616182 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15c15010-e626-4089-9150-fc5e373331f6" path="/var/lib/kubelet/pods/15c15010-e626-4089-9150-fc5e373331f6/volumes" Nov 04 05:56:04.542582 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.542551 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf"] Nov 04 05:56:04.542910 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.542896 4932 cpu_manager.go:414] "containerMap: removing container" podUID="15c15010-e626-4089-9150-fc5e373331f6" containerName="manager" Nov 04 05:56:04.542962 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.542911 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15c15010-e626-4089-9150-fc5e373331f6" containerName="manager" Nov 04 05:56:04.542993 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.542984 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="15c15010-e626-4089-9150-fc5e373331f6" containerName="manager" Nov 04 05:56:04.549920 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.549901 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.616852 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.616823 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf"] Nov 04 05:56:04.667834 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.667808 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k2hvn\"" Nov 04 05:56:04.704211 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704181 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704466 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704219 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f59676f7-1a81-4862-b7a0-06b2b84386dd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704466 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704256 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704610 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704509 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm25x\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-kube-api-access-vm25x\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704675 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704620 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704675 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704655 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704806 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704676 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704863 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704818 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.704930 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.704894 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.805667 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805579 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.805667 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805618 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.805667 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805636 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.805667 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805653 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805707 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805763 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f59676f7-1a81-4862-b7a0-06b2b84386dd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805800 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805839 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm25x\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-kube-api-access-vm25x\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.805888 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.806167 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806247 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.806223 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806354 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.806327 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806408 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.806355 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.806554 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.806533 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f59676f7-1a81-4862-b7a0-06b2b84386dd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.807962 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.807945 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.808095 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.808078 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.870335 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.870301 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm25x\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-kube-api-access-vm25x\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:04.870465 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:04.870343 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f59676f7-1a81-4862-b7a0-06b2b84386dd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf\" (UID: \"f59676f7-1a81-4862-b7a0-06b2b84386dd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:05.161755 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:05.161653 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:05.601889 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:05.601859 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf"] Nov 04 05:56:05.602632 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:56:05.602606 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59676f7_1a81_4862_b7a0_06b2b84386dd.slice/crio-3ca7506c03a57c435947cc2e0325603510fa75f7ed1b6f5655eae18ee41203d9 WatchSource:0}: Error finding container 3ca7506c03a57c435947cc2e0325603510fa75f7ed1b6f5655eae18ee41203d9: Status 404 returned error can't find the container with id 3ca7506c03a57c435947cc2e0325603510fa75f7ed1b6f5655eae18ee41203d9 Nov 04 05:56:05.604763 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:05.604720 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:56:05.604843 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:05.604799 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:56:05.604843 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:05.604829 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:56:06.005866 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:06.005831 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" event={"ID":"f59676f7-1a81-4862-b7a0-06b2b84386dd","Type":"ContainerStarted","Data":"e9e18b7c50279bceda3c058d319c6a1cc5dfc04d97078894972fdb1349c45c3d"} Nov 04 05:56:06.006273 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:06.005886 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" event={"ID":"f59676f7-1a81-4862-b7a0-06b2b84386dd","Type":"ContainerStarted","Data":"3ca7506c03a57c435947cc2e0325603510fa75f7ed1b6f5655eae18ee41203d9"} Nov 04 05:56:06.162183 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:06.162153 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:06.166912 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:06.166888 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:06.210698 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:06.210652 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" podStartSLOduration=2.210637206 podStartE2EDuration="2.210637206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:06.20928807 +0000 UTC m=+414.706682834" watchObservedRunningTime="2026-11-04 05:56:06.210637206 +0000 UTC m=+414.708031968" Nov 04 05:56:07.010897 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:07.010858 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:07.011959 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:07.011938 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf" Nov 04 05:56:17.368895 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:56:17.368854 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:56:20.501038 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.501005 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:20.505806 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.505788 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:20.547788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.547764 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s2qn\" (UniqueName: \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\") pod \"authorino-57f7f8659f-vkr2g\" (UID: \"30e0b832-1c4b-41a4-9f12-5b670820e192\") " pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:20.562645 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.562622 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:20.613939 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.613907 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8mtfn\"" Nov 04 05:56:20.648742 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.648699 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s2qn\" (UniqueName: \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\") pod \"authorino-57f7f8659f-vkr2g\" (UID: \"30e0b832-1c4b-41a4-9f12-5b670820e192\") " pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:20.713362 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.713333 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s2qn\" (UniqueName: \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\") pod \"authorino-57f7f8659f-vkr2g\" (UID: \"30e0b832-1c4b-41a4-9f12-5b670820e192\") " pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:20.826118 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:20.826037 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:21.200687 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:21.200660 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:21.201419 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:56:21.201392 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30e0b832_1c4b_41a4_9f12_5b670820e192.slice/crio-2085378ba93c958d59a0728d245c93fca2c9495cb8c56a55be2dd9d4450c6b43 WatchSource:0}: Error finding container 2085378ba93c958d59a0728d245c93fca2c9495cb8c56a55be2dd9d4450c6b43: Status 404 returned error can't find the container with id 2085378ba93c958d59a0728d245c93fca2c9495cb8c56a55be2dd9d4450c6b43 Nov 04 05:56:22.090626 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:22.090593 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" event={"ID":"30e0b832-1c4b-41a4-9f12-5b670820e192","Type":"ContainerStarted","Data":"2085378ba93c958d59a0728d245c93fca2c9495cb8c56a55be2dd9d4450c6b43"} Nov 04 05:56:23.966228 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:23.966193 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:56:23.969710 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:23.969689 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:56:23.972039 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:23.972019 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\") pod \"authorino-56c6c9ddd5-kb7jk\" (UID: \"3fe2e222-3750-4de6-9060-e30050953a60\") " pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:56:24.028159 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.028093 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:56:24.072756 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.072709 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\") pod \"authorino-56c6c9ddd5-kb7jk\" (UID: \"3fe2e222-3750-4de6-9060-e30050953a60\") " pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:56:24.103341 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.103306 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" event={"ID":"30e0b832-1c4b-41a4-9f12-5b670820e192","Type":"ContainerStarted","Data":"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1"} Nov 04 05:56:24.137564 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.137530 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\") pod \"authorino-56c6c9ddd5-kb7jk\" (UID: \"3fe2e222-3750-4de6-9060-e30050953a60\") " pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:56:24.225227 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.225179 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" podStartSLOduration=1.675144785 podStartE2EDuration="4.225164286s" totalImagesPullingTime="2.550019501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:24.223845067 +0000 UTC m=+432.721239829" watchObservedRunningTime="2026-11-04 05:56:24.225164286 +0000 UTC m=+432.722559042" Nov 04 05:56:24.281395 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.281324 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:56:24.664568 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:24.664542 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:56:24.665287 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:56:24.665257 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fe2e222_3750_4de6_9060_e30050953a60.slice/crio-fe68bc0cc73d498eb19bc6d2a9e4c61588b9b123384aa182b6a60d77026bbd61 WatchSource:0}: Error finding container fe68bc0cc73d498eb19bc6d2a9e4c61588b9b123384aa182b6a60d77026bbd61: Status 404 returned error can't find the container with id fe68bc0cc73d498eb19bc6d2a9e4c61588b9b123384aa182b6a60d77026bbd61 Nov 04 05:56:25.109332 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:25.109296 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" event={"ID":"3fe2e222-3750-4de6-9060-e30050953a60","Type":"ContainerStarted","Data":"fe68bc0cc73d498eb19bc6d2a9e4c61588b9b123384aa182b6a60d77026bbd61"} Nov 04 05:56:26.116487 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.116460 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" event={"ID":"3fe2e222-3750-4de6-9060-e30050953a60","Type":"ContainerStarted","Data":"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0"} Nov 04 05:56:26.239355 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.239300 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" podStartSLOduration=1.867275358 podStartE2EDuration="3.2392868s" totalImagesPullingTime="1.372011442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:26.238787195 +0000 UTC m=+434.736181960" watchObservedRunningTime="2026-11-04 05:56:26.2392868 +0000 UTC m=+434.736681563" Nov 04 05:56:26.270071 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.270037 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:26.270230 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.270213 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" podUID="30e0b832-1c4b-41a4-9f12-5b670820e192" containerName="authorino" containerID="cri-o://9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1" gracePeriod=30 Nov 04 05:56:26.524543 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.524508 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:26.589204 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.589178 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\" (UniqueName: \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\") pod \"30e0b832-1c4b-41a4-9f12-5b670820e192\" (UID: \"30e0b832-1c4b-41a4-9f12-5b670820e192\") " Nov 04 05:56:26.591162 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.591134 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn" pod "30e0b832-1c4b-41a4-9f12-5b670820e192" (UID: "30e0b832-1c4b-41a4-9f12-5b670820e192"). InnerVolumeSpecName "kube-api-access-2s2qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:56:26.689803 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:26.689717 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s2qn\" (UniqueName: \"kubernetes.io/projected/30e0b832-1c4b-41a4-9f12-5b670820e192-kube-api-access-2s2qn\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:56:27.127750 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.127689 4932 generic.go:356] "Generic (PLEG): container finished" podID="30e0b832-1c4b-41a4-9f12-5b670820e192" containerID="9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1" exitCode=0 Nov 04 05:56:27.128174 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.127782 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" event={"ID":"30e0b832-1c4b-41a4-9f12-5b670820e192","Type":"ContainerDied","Data":"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1"} Nov 04 05:56:27.128174 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.127833 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" event={"ID":"30e0b832-1c4b-41a4-9f12-5b670820e192","Type":"ContainerDied","Data":"2085378ba93c958d59a0728d245c93fca2c9495cb8c56a55be2dd9d4450c6b43"} Nov 04 05:56:27.128174 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.127793 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vkr2g" Nov 04 05:56:27.128174 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.127853 4932 scope.go:122] "RemoveContainer" containerID="9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1" Nov 04 05:56:27.136678 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.136664 4932 scope.go:122] "RemoveContainer" containerID="9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1" Nov 04 05:56:27.136990 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:56:27.136959 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1\": container with ID starting with 9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1 not found: ID does not exist" containerID="9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1" Nov 04 05:56:27.137058 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.136998 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1"} err="failed to get container status \"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1\": rpc error: code = NotFound desc = could not find container \"9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1\": container with ID starting with 9c465008f2f8a4c69c7f23a53a70796a6c0371014fff38fb37dffd258a88e2b1 not found: ID does not exist" Nov 04 05:56:27.303213 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.303181 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:27.356500 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.356464 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vkr2g"] Nov 04 05:56:27.616762 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:27.616712 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30e0b832-1c4b-41a4-9f12-5b670820e192" path="/var/lib/kubelet/pods/30e0b832-1c4b-41a4-9f12-5b670820e192/volumes" Nov 04 05:56:32.164491 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.164457 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l"] Nov 04 05:56:32.165110 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.164986 4932 cpu_manager.go:414] "containerMap: removing container" podUID="30e0b832-1c4b-41a4-9f12-5b670820e192" containerName="authorino" Nov 04 05:56:32.165110 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.165006 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30e0b832-1c4b-41a4-9f12-5b670820e192" containerName="authorino" Nov 04 05:56:32.165227 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.165131 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="30e0b832-1c4b-41a4-9f12-5b670820e192" containerName="authorino" Nov 04 05:56:32.169707 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.169686 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.226325 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226304 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 05:56:32.226325 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226309 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-r5nhg\"" Nov 04 05:56:32.226514 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226495 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c160027-80c5-46f8-830d-80cc272365f4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.226551 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226530 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hxc\" (UniqueName: \"kubernetes.io/projected/2c160027-80c5-46f8-830d-80cc272365f4-kube-api-access-75hxc\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.226612 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226600 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.226663 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.226643 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.279740 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.279712 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 05:56:32.327654 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.327630 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.327795 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.327669 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.327795 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.327760 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c160027-80c5-46f8-830d-80cc272365f4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.327897 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.327799 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hxc\" (UniqueName: \"kubernetes.io/projected/2c160027-80c5-46f8-830d-80cc272365f4-kube-api-access-75hxc\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.328033 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.328017 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.328100 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.328071 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c160027-80c5-46f8-830d-80cc272365f4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.388070 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.388047 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Nov 04 05:56:32.394553 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.394522 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l"] Nov 04 05:56:32.396173 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.396149 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hxc\" (UniqueName: \"kubernetes.io/projected/2c160027-80c5-46f8-830d-80cc272365f4-kube-api-access-75hxc\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.398803 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.398777 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c160027-80c5-46f8-830d-80cc272365f4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-gmr6l\" (UID: \"2c160027-80c5-46f8-830d-80cc272365f4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.482496 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.482463 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:32.925025 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:56:32.924990 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c160027_80c5_46f8_830d_80cc272365f4.slice/crio-fe78528171674d0623d7bad93085337f4eb554f673fd63c25722f19541da4270 WatchSource:0}: Error finding container fe78528171674d0623d7bad93085337f4eb554f673fd63c25722f19541da4270: Status 404 returned error can't find the container with id fe78528171674d0623d7bad93085337f4eb554f673fd63c25722f19541da4270 Nov 04 05:56:32.925387 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:32.925367 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l"] Nov 04 05:56:33.160997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:33.160953 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" event={"ID":"2c160027-80c5-46f8-830d-80cc272365f4","Type":"ContainerStarted","Data":"fe78528171674d0623d7bad93085337f4eb554f673fd63c25722f19541da4270"} Nov 04 05:56:36.181215 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:36.181172 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" event={"ID":"2c160027-80c5-46f8-830d-80cc272365f4","Type":"ContainerStarted","Data":"7464f9b8b8549ee5f5828ff46e37a20caab2439f71b582bfcb60b5402ff1639d"} Nov 04 05:56:36.181601 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:36.181306 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:56:36.360524 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:36.360468 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" podStartSLOduration=1.663600864 podStartE2EDuration="4.360451754s" totalImagesPullingTime="2.69685089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:36.360402224 +0000 UTC m=+444.857796988" watchObservedRunningTime="2026-11-04 05:56:36.360451754 +0000 UTC m=+444.857846517" Nov 04 05:56:45.566040 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.565996 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g"] Nov 04 05:56:45.569821 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.569805 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.627883 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.627856 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 05:56:45.630393 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.630365 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g"] Nov 04 05:56:45.641300 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.641275 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhm4\" (UniqueName: \"kubernetes.io/projected/b2f4e006-ab6e-4956-83ef-325c27641566-kube-api-access-rhhm4\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.641418 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.641336 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2f4e006-ab6e-4956-83ef-325c27641566-data\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.681427 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.681403 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 05:56:45.722187 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.722160 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 04 05:56:45.722328 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.722188 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4s457\"" Nov 04 05:56:45.742026 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.742005 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2f4e006-ab6e-4956-83ef-325c27641566-data\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.742128 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.742091 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhm4\" (UniqueName: \"kubernetes.io/projected/b2f4e006-ab6e-4956-83ef-325c27641566-kube-api-access-rhhm4\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.742475 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.742457 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2f4e006-ab6e-4956-83ef-325c27641566-data\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.807740 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.807699 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhm4\" (UniqueName: \"kubernetes.io/projected/b2f4e006-ab6e-4956-83ef-325c27641566-kube-api-access-rhhm4\") pod \"postgres-7cdbf6dc44-g664g\" (UID: \"b2f4e006-ab6e-4956-83ef-325c27641566\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:45.881997 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:45.881936 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:46.257641 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:46.257615 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g"] Nov 04 05:56:46.258880 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:56:46.258856 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f4e006_ab6e_4956_83ef_325c27641566.slice/crio-4fb24c3c2762e9dfabceb11e65991522476faba33fda146c54bbd83a763a3df7 WatchSource:0}: Error finding container 4fb24c3c2762e9dfabceb11e65991522476faba33fda146c54bbd83a763a3df7: Status 404 returned error can't find the container with id 4fb24c3c2762e9dfabceb11e65991522476faba33fda146c54bbd83a763a3df7 Nov 04 05:56:47.240745 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:47.240690 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" event={"ID":"b2f4e006-ab6e-4956-83ef-325c27641566","Type":"ContainerStarted","Data":"4fb24c3c2762e9dfabceb11e65991522476faba33fda146c54bbd83a763a3df7"} Nov 04 05:56:47.369350 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:56:47.369311 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:56:54.282248 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:54.282211 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" event={"ID":"b2f4e006-ab6e-4956-83ef-325c27641566","Type":"ContainerStarted","Data":"91c5df2ceb43555bd617a4d24e2a9bfce2e8804ac0d1a7f4535a740dda1e4c35"} Nov 04 05:56:54.282659 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:54.282333 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:56:54.405693 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:54.405634 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" podStartSLOduration=2.3906420219999998 podStartE2EDuration="9.405618343s" totalImagesPullingTime="7.014976321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:54.404373984 +0000 UTC m=+462.901768748" watchObservedRunningTime="2026-11-04 05:56:54.405618343 +0000 UTC m=+462.903013108" Nov 04 05:56:57.187521 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:56:57.187490 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-gmr6l" Nov 04 05:57:00.316130 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:00.316100 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-g664g" Nov 04 05:57:17.369321 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:57:17.369278 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:57:33.572910 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.572871 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7"] Nov 04 05:57:33.591469 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.591433 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652274 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652246 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652274 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652276 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652483 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652316 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652483 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652447 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652579 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652483 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5bnv\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-kube-api-access-h5bnv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652579 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652557 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.652652 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.652601 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.685099 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.685077 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-497ww\"" Nov 04 05:57:33.696195 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.696175 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 04 05:57:33.696284 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.696195 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 04 05:57:33.696284 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.696193 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 04 05:57:33.744148 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.744125 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7"] Nov 04 05:57:33.753022 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753000 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753127 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753042 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753127 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753075 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5bnv\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-kube-api-access-h5bnv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753127 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753103 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753296 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753134 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753296 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753180 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.753398 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.753357 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.754179 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.754149 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.755615 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.755592 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.755699 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.755665 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.755816 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.755794 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.756002 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.755984 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.828662 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.828592 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.835344 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.835322 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5bnv\" (UniqueName: \"kubernetes.io/projected/e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465-kube-api-access-h5bnv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-x8ks7\" (UID: \"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:33.901766 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:33.901718 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:34.340065 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:34.340028 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7"] Nov 04 05:57:34.379517 ip-10-0-133-0 kubenswrapper[4932]: W1104 05:57:34.379492 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bc0e2d_9d48_4ad2_b0f0_ea0f30569465.slice/crio-6ca7d5e6be8b75e76c23ba9365fe25ad3410d20241958b9e5899b5f6a198147d WatchSource:0}: Error finding container 6ca7d5e6be8b75e76c23ba9365fe25ad3410d20241958b9e5899b5f6a198147d: Status 404 returned error can't find the container with id 6ca7d5e6be8b75e76c23ba9365fe25ad3410d20241958b9e5899b5f6a198147d Nov 04 05:57:34.490338 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:34.490309 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" event={"ID":"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465","Type":"ContainerStarted","Data":"6ca7d5e6be8b75e76c23ba9365fe25ad3410d20241958b9e5899b5f6a198147d"} Nov 04 05:57:37.963446 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:37.963409 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:57:37.963887 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:37.963509 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:57:38.514638 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:38.514598 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" event={"ID":"e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465","Type":"ContainerStarted","Data":"5e9e473668e4599be7a16f672f96d83360a1de7d3bce02287a028c2f8bf73413"} Nov 04 05:57:38.514829 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:38.514666 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:38.750259 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:38.750199 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" podStartSLOduration=2.169016836 podStartE2EDuration="5.750185182s" totalImagesPullingTime="3.581168346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:38.702800929 +0000 UTC m=+507.200195694" watchObservedRunningTime="2026-11-04 05:57:38.750185182 +0000 UTC m=+507.247579944" Nov 04 05:57:39.521122 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:39.521089 4932 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:57:39.521489 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:39.521142 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" podUID="e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:57:42.520788 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:57:42.520759 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7" Nov 04 05:57:47.368839 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:57:47.368799 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:58:00.652087 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.652052 4932 generic.go:356] "Generic (PLEG): container finished" podID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerID="4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47" exitCode=0 Nov 04 05:58:00.652941 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.652129 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerDied","Data":"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47"} Nov 04 05:58:00.652941 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.652568 4932 scope.go:122] "RemoveContainer" containerID="4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47" Nov 04 05:58:00.653750 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.653701 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:58:00.653811 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.653785 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:58:00.653848 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:00.653818 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 05:58:01.261439 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.261407 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:58:01.261613 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.261582 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" podUID="3fe2e222-3750-4de6-9060-e30050953a60" containerName="authorino" containerID="cri-o://3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0" gracePeriod=30 Nov 04 05:58:01.542243 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.542221 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:58:01.617750 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.617001 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\") pod \"3fe2e222-3750-4de6-9060-e30050953a60\" (UID: \"3fe2e222-3750-4de6-9060-e30050953a60\") " Nov 04 05:58:01.621005 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.620963 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8" pod "3fe2e222-3750-4de6-9060-e30050953a60" (UID: "3fe2e222-3750-4de6-9060-e30050953a60"). InnerVolumeSpecName "kube-api-access-v54z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:58:01.658390 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.658360 4932 generic.go:356] "Generic (PLEG): container finished" podID="3fe2e222-3750-4de6-9060-e30050953a60" containerID="3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0" exitCode=0 Nov 04 05:58:01.658721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.658402 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" Nov 04 05:58:01.658721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.658438 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" event={"ID":"3fe2e222-3750-4de6-9060-e30050953a60","Type":"ContainerDied","Data":"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0"} Nov 04 05:58:01.658721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.658485 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-kb7jk" event={"ID":"3fe2e222-3750-4de6-9060-e30050953a60","Type":"ContainerDied","Data":"fe68bc0cc73d498eb19bc6d2a9e4c61588b9b123384aa182b6a60d77026bbd61"} Nov 04 05:58:01.658721 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.658506 4932 scope.go:122] "RemoveContainer" containerID="3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0" Nov 04 05:58:01.660787 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.660754 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerStarted","Data":"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878"} Nov 04 05:58:01.667079 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.667059 4932 scope.go:122] "RemoveContainer" containerID="3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0" Nov 04 05:58:01.667339 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:58:01.667323 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0\": container with ID starting with 3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0 not found: ID does not exist" containerID="3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0" Nov 04 05:58:01.667394 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.667345 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0"} err="failed to get container status \"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0\": rpc error: code = NotFound desc = could not find container \"3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0\": container with ID starting with 3a1aa5f668b9f1ec0ffab9f363fb5116607b23ad8460099e5fd9e093ffed27c0 not found: ID does not exist" Nov 04 05:58:01.719698 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.719402 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/3fe2e222-3750-4de6-9060-e30050953a60-kube-api-access-v54z8\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:58:01.924239 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.924150 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:58:01.924396 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.924335 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Nov 04 05:58:01.924396 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.924379 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Nov 04 05:58:01.937893 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.937868 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:58:01.945992 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:01.945971 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-kb7jk"] Nov 04 05:58:02.923966 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:02.923922 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Nov 04 05:58:02.924357 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:02.923980 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Nov 04 05:58:03.622512 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:03.622479 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fe2e222-3750-4de6-9060-e30050953a60" path="/var/lib/kubelet/pods/3fe2e222-3750-4de6-9060-e30050953a60/volumes" Nov 04 05:58:03.924118 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:03.924037 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Nov 04 05:58:03.924118 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:03.924104 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Nov 04 05:58:04.924236 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:04.924199 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Nov 04 05:58:04.924695 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:04.924271 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Nov 04 05:58:05.924512 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:05.924476 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Nov 04 05:58:05.924902 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:05.924531 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Nov 04 05:58:06.928169 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:06.928133 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:58:06.928604 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:06.928509 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:58:06.929105 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:58:06.929087 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 05:58:17.368798 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:58:17.368759 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:58:47.368344 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:58:47.368303 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:59:11.671453 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:59:11.671427 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:59:11.675001 ip-10-0-133-0 kubenswrapper[4932]: I1104 05:59:11.674980 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 05:59:17.369191 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:59:17.369154 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 05:59:47.368621 ip-10-0-133-0 kubenswrapper[4932]: E1104 05:59:47.368584 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:00:00.169514 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.169469 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:00.170000 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.169866 4932 cpu_manager.go:414] "containerMap: removing container" podUID="3fe2e222-3750-4de6-9060-e30050953a60" containerName="authorino" Nov 04 06:00:00.170000 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.169877 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fe2e222-3750-4de6-9060-e30050953a60" containerName="authorino" Nov 04 06:00:00.170000 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.169953 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fe2e222-3750-4de6-9060-e30050953a60" containerName="authorino" Nov 04 06:00:00.172968 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.172954 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.214229 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.214197 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.214388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.214309 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdr6\" (UniqueName: \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.233936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.233915 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:00.284242 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.284215 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:00:00.314961 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.314936 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdr6\" (UniqueName: \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.315112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.315084 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.315696 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.315681 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.380084 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.380056 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdr6\" (UniqueName: \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\") pod \"maas-api-key-cleanup-29896200-s7cqq\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.484600 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.484572 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:00.865693 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.865671 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:00.867974 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:00:00.867933 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7f7532_1c94_404f_b68f_1b8e81534f22.slice/crio-2c2b5f5fc03e490587d52fdf530a396507d349e289509accfa79cc6cefa5567e WatchSource:0}: Error finding container 2c2b5f5fc03e490587d52fdf530a396507d349e289509accfa79cc6cefa5567e: Status 404 returned error can't find the container with id 2c2b5f5fc03e490587d52fdf530a396507d349e289509accfa79cc6cefa5567e Nov 04 06:00:00.869912 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:00.869896 4932 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 06:00:01.293233 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:01.293198 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerStarted","Data":"2c2b5f5fc03e490587d52fdf530a396507d349e289509accfa79cc6cefa5567e"} Nov 04 06:00:07.331820 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:07.331782 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerStarted","Data":"c216a934e08ce5f5a36121394e6c9b5d2fe8fc1ef3b23c3bedf3093c05e04309"} Nov 04 06:00:07.455002 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:07.454947 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" podStartSLOduration=1.6117843299999999 podStartE2EDuration="7.454932448s" totalImagesPullingTime="5.843148118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:07.453787168 +0000 UTC m=+655.951181931" watchObservedRunningTime="2026-11-04 06:00:07.454932448 +0000 UTC m=+655.952327212" Nov 04 06:00:08.338495 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:08.338461 4932 generic.go:356] "Generic (PLEG): container finished" podID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerID="c216a934e08ce5f5a36121394e6c9b5d2fe8fc1ef3b23c3bedf3093c05e04309" exitCode=60 Nov 04 06:00:08.338903 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:08.338531 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerDied","Data":"c216a934e08ce5f5a36121394e6c9b5d2fe8fc1ef3b23c3bedf3093c05e04309"} Nov 04 06:00:08.338903 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:08.338775 4932 scope.go:122] "RemoveContainer" containerID="c216a934e08ce5f5a36121394e6c9b5d2fe8fc1ef3b23c3bedf3093c05e04309" Nov 04 06:00:09.345507 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:09.345469 4932 generic.go:356] "Generic (PLEG): container finished" podID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerID="a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b" exitCode=60 Nov 04 06:00:09.345978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:09.345523 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerDied","Data":"a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b"} Nov 04 06:00:09.345978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:09.345598 4932 scope.go:122] "RemoveContainer" containerID="c216a934e08ce5f5a36121394e6c9b5d2fe8fc1ef3b23c3bedf3093c05e04309" Nov 04 06:00:09.345978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:09.345823 4932 scope.go:122] "RemoveContainer" containerID="a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b" Nov 04 06:00:09.346099 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:00:09.346068 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896200-s7cqq_odh-ai-gateway-infra(ee7f7532-1c94-404f-b68f-1b8e81534f22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" Nov 04 06:00:10.352474 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:10.352444 4932 scope.go:122] "RemoveContainer" containerID="a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b" Nov 04 06:00:10.352923 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:00:10.352653 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896200-s7cqq_odh-ai-gateway-infra(ee7f7532-1c94-404f-b68f-1b8e81534f22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" Nov 04 06:00:17.369280 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:00:17.369236 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:00:21.614064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:21.614034 4932 scope.go:122] "RemoveContainer" containerID="a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b" Nov 04 06:00:22.415823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:22.415796 4932 generic.go:356] "Generic (PLEG): container finished" podID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerID="110c3591d8405a0a0340693ddc869c46d3d9489e7820f951ff0c7ef8dda58811" exitCode=60 Nov 04 06:00:22.415964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:22.415879 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerDied","Data":"110c3591d8405a0a0340693ddc869c46d3d9489e7820f951ff0c7ef8dda58811"} Nov 04 06:00:22.416031 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:22.415961 4932 scope.go:122] "RemoveContainer" containerID="a7c66a5de5a5c47cc9c412f6fb8d1a0df1a6b0ae1e6ca1cf58af11281e9d5e0b" Nov 04 06:00:22.416304 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:22.416286 4932 scope.go:122] "RemoveContainer" containerID="110c3591d8405a0a0340693ddc869c46d3d9489e7820f951ff0c7ef8dda58811" Nov 04 06:00:22.416525 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:00:22.416505 4932 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29896200-s7cqq_odh-ai-gateway-infra(ee7f7532-1c94-404f-b68f-1b8e81534f22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" Nov 04 06:00:23.553153 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.553112 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:23.696653 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.696619 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:23.833007 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.832914 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\") pod \"ee7f7532-1c94-404f-b68f-1b8e81534f22\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " Nov 04 06:00:23.833173 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.833058 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\" (UniqueName: \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\") pod \"ee7f7532-1c94-404f-b68f-1b8e81534f22\" (UID: \"ee7f7532-1c94-404f-b68f-1b8e81534f22\") " Nov 04 06:00:23.834049 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.834018 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca" pod "ee7f7532-1c94-404f-b68f-1b8e81534f22" (UID: "ee7f7532-1c94-404f-b68f-1b8e81534f22"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:00:23.836055 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.836020 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6" pod "ee7f7532-1c94-404f-b68f-1b8e81534f22" (UID: "ee7f7532-1c94-404f-b68f-1b8e81534f22"). InnerVolumeSpecName "kube-api-access-4hdr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:00:23.934631 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.934591 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hdr6\" (UniqueName: \"kubernetes.io/projected/ee7f7532-1c94-404f-b68f-1b8e81534f22-kube-api-access-4hdr6\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:00:23.934631 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:23.934633 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7f7532-1c94-404f-b68f-1b8e81534f22-maas-api-service-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:00:24.214258 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214175 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt"] Nov 04 06:00:24.214608 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214591 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.214698 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214610 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.214698 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214638 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.214698 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214646 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.214883 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214797 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.214883 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.214820 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:24.218174 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.218154 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.276609 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.276573 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 04 06:00:24.329934 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.329907 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 04 06:00:24.330104 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.330028 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6xl4t\"" Nov 04 06:00:24.330104 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.330043 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Nov 04 06:00:24.332394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.332371 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt"] Nov 04 06:00:24.338893 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.338873 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.338893 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.338895 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.339046 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.338915 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlq8p\" (UniqueName: \"kubernetes.io/projected/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-kube-api-access-hlq8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.339046 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.338938 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.339183 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.339041 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.339183 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.339091 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.439615 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439574 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.439855 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439679 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.439855 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439710 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.439855 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439773 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlq8p\" (UniqueName: \"kubernetes.io/projected/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-kube-api-access-hlq8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.439855 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439810 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.440109 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.439860 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.440327 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.440303 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.440570 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.440542 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" event={"ID":"ee7f7532-1c94-404f-b68f-1b8e81534f22","Type":"ContainerDied","Data":"2c2b5f5fc03e490587d52fdf530a396507d349e289509accfa79cc6cefa5567e"} Nov 04 06:00:24.440672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.440617 4932 scope.go:122] "RemoveContainer" containerID="110c3591d8405a0a0340693ddc869c46d3d9489e7820f951ff0c7ef8dda58811" Nov 04 06:00:24.442274 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.441968 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.446068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.442488 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq" Nov 04 06:00:24.446489 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.446437 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.452890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.452866 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.455623 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.455600 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.508167 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.508135 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlq8p\" (UniqueName: \"kubernetes.io/projected/5bce6947-8dcb-43dc-9aa8-b3b2ef87455a-kube-api-access-hlq8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt\" (UID: \"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.536865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.536825 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:24.626764 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.623589 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:24.627336 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.627309 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896200-s7cqq"] Nov 04 06:00:24.918689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:24.918653 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt"] Nov 04 06:00:24.919565 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:00:24.919538 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce6947_8dcb_43dc_9aa8_b3b2ef87455a.slice/crio-c4790a0d7e0b3086fa6f2e747124e5620a707110889c1e49aa085902810972df WatchSource:0}: Error finding container c4790a0d7e0b3086fa6f2e747124e5620a707110889c1e49aa085902810972df: Status 404 returned error can't find the container with id c4790a0d7e0b3086fa6f2e747124e5620a707110889c1e49aa085902810972df Nov 04 06:00:25.244321 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.244288 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw"] Nov 04 06:00:25.244710 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.244694 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:25.244828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.244713 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:25.244914 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.244860 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" containerName="cleanup" Nov 04 06:00:25.249150 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.249130 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.340185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.340143 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw"] Nov 04 06:00:25.348021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.347989 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348158 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348058 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsfq\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-kube-api-access-qgsfq\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348158 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348102 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348232 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348185 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348265 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348229 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba58e07-66e9-426e-9069-6f9c0a697906-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348307 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348282 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348327 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348377 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348348 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba58e07-66e9-426e-9069-6f9c0a697906-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.348459 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.348441 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.447366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.447330 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" event={"ID":"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a","Type":"ContainerStarted","Data":"c4790a0d7e0b3086fa6f2e747124e5620a707110889c1e49aa085902810972df"} Nov 04 06:00:25.449803 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449777 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsfq\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-kube-api-access-qgsfq\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.449943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449817 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.449943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449846 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.449943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449892 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba58e07-66e9-426e-9069-6f9c0a697906-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449954 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.449982 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450012 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba58e07-66e9-426e-9069-6f9c0a697906-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450200 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450056 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450200 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450162 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450299 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450253 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450423 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450405 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450512 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450489 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450570 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450511 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.450978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.450941 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba58e07-66e9-426e-9069-6f9c0a697906-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.452210 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.452191 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba58e07-66e9-426e-9069-6f9c0a697906-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.452348 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.452330 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba58e07-66e9-426e-9069-6f9c0a697906-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.514023 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.513945 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.514142 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.514040 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsfq\" (UniqueName: \"kubernetes.io/projected/fba58e07-66e9-426e-9069-6f9c0a697906-kube-api-access-qgsfq\") pod \"maas-default-gateway-openshift-default-6886b96f9-gk4kw\" (UID: \"fba58e07-66e9-426e-9069-6f9c0a697906\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.561770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.561740 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:25.620768 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:25.620719 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee7f7532-1c94-404f-b68f-1b8e81534f22" path="/var/lib/kubelet/pods/ee7f7532-1c94-404f-b68f-1b8e81534f22/volumes" Nov 04 06:00:26.005376 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.005351 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw"] Nov 04 06:00:26.005957 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:00:26.005930 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba58e07_66e9_426e_9069_6f9c0a697906.slice/crio-2e286cab39b2da544040ba5ea2a06ca00f919b29f7654065dc6afdbd0e6d67c3 WatchSource:0}: Error finding container 2e286cab39b2da544040ba5ea2a06ca00f919b29f7654065dc6afdbd0e6d67c3: Status 404 returned error can't find the container with id 2e286cab39b2da544040ba5ea2a06ca00f919b29f7654065dc6afdbd0e6d67c3 Nov 04 06:00:26.008072 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.008030 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:00:26.008162 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.008112 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:00:26.008162 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.008147 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:00:26.456656 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.456556 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" event={"ID":"fba58e07-66e9-426e-9069-6f9c0a697906","Type":"ContainerStarted","Data":"cf6c5e5e5532c1ea69d0f62a8a1cc61507e64fa92a21bc36979c7e57567c3159"} Nov 04 06:00:26.456878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.456658 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" event={"ID":"fba58e07-66e9-426e-9069-6f9c0a697906","Type":"ContainerStarted","Data":"2e286cab39b2da544040ba5ea2a06ca00f919b29f7654065dc6afdbd0e6d67c3"} Nov 04 06:00:26.561911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.561875 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:26.585683 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:26.585628 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podStartSLOduration=1.585614846 podStartE2EDuration="1.585614846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:26.583803265 +0000 UTC m=+675.081198030" watchObservedRunningTime="2026-11-04 06:00:26.585614846 +0000 UTC m=+675.083009610" Nov 04 06:00:27.464540 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:27.464496 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" event={"ID":"5bce6947-8dcb-43dc-9aa8-b3b2ef87455a","Type":"ContainerStarted","Data":"b61eb973c9f41caa9fb9e6859d54152e4d960777ae6242ab8dd0a21202b83441"} Nov 04 06:00:27.537831 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:27.537788 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:27.563852 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:27.563823 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:27.563997 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:27.563871 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:27.590836 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:27.590790 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" podStartSLOduration=1.834982332 podStartE2EDuration="3.590777748s" totalImagesPullingTime="1.755795416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:27.588616536 +0000 UTC m=+676.086011300" watchObservedRunningTime="2026-11-04 06:00:27.590777748 +0000 UTC m=+676.088172511" Nov 04 06:00:28.562510 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:28.562471 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:28.562994 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:28.562531 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:29.562124 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:29.562090 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:29.562300 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:29.562156 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:30.562601 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:30.562548 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:30.563144 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:30.562618 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:31.563764 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:31.563704 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:31.564240 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:31.563791 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:32.563085 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:32.563050 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:00:32.563282 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:32.563110 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 06:00:34.537793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:34.537720 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:34.549433 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:34.549402 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:34.562781 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:34.562747 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 06:00:34.562934 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:34.562804 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 06:00:35.528230 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:35.528196 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt" Nov 04 06:00:35.603908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:35.603864 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 06:00:35.604419 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:35.603930 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 06:00:36.605212 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:36.605160 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 06:00:36.606240 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:36.605244 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 06:00:37.646914 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:37.646860 4932 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 06:00:37.647443 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:37.646965 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" podUID="fba58e07-66e9-426e-9069-6f9c0a697906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 06:00:38.362992 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:38.362962 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:38.363250 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:38.363232 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:38.363965 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:00:38.363943 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw" Nov 04 06:00:47.369090 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:00:47.369050 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:01:04.144297 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.144256 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:04.155412 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.155372 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.208514 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.208478 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:04.230208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.230177 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkw5\" (UniqueName: \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.230392 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.230217 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.256219 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.256187 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 04 06:01:04.259606 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.259579 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-49z57\"" Nov 04 06:01:04.259762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.259635 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 04 06:01:04.331582 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.331550 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkw5\" (UniqueName: \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.331819 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.331590 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.334159 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.334135 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.396617 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.396547 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkw5\" (UniqueName: \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\") pod \"ai-gateway-controller-7958bf97d9-b55f4\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.470188 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.470158 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:04.852358 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:04.852326 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:04.853054 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:01:04.853024 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb535e99b_3ca1_4336_971a_3116675274b1.slice/crio-e5ca23a6f3548c93aba3b67dafbd9b505883081fb8f90e8ee9937a9272903602 WatchSource:0}: Error finding container e5ca23a6f3548c93aba3b67dafbd9b505883081fb8f90e8ee9937a9272903602: Status 404 returned error can't find the container with id e5ca23a6f3548c93aba3b67dafbd9b505883081fb8f90e8ee9937a9272903602 Nov 04 06:01:05.680120 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:05.680077 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" event={"ID":"b535e99b-3ca1-4336-971a-3116675274b1","Type":"ContainerStarted","Data":"e5ca23a6f3548c93aba3b67dafbd9b505883081fb8f90e8ee9937a9272903602"} Nov 04 06:01:10.711092 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:10.711049 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" event={"ID":"b535e99b-3ca1-4336-971a-3116675274b1","Type":"ContainerStarted","Data":"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393"} Nov 04 06:01:10.711542 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:10.711137 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:10.835316 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:10.835255 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" podStartSLOduration=1.223996577 podStartE2EDuration="6.83524126s" totalImagesPullingTime="5.611244683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:01:10.834077249 +0000 UTC m=+719.331472013" watchObservedRunningTime="2026-11-04 06:01:10.83524126 +0000 UTC m=+719.332636018" Nov 04 06:01:13.837988 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:13.837956 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp"] Nov 04 06:01:13.842792 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:13.842770 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:13.952942 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:13.952911 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xsvcz\"" Nov 04 06:01:13.952942 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:13.952913 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Nov 04 06:01:13.955390 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:13.955361 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp"] Nov 04 06:01:14.009194 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.009155 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-246k6"] Nov 04 06:01:14.012954 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.012929 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.026375 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.026340 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcmbv\" (UniqueName: \"kubernetes.io/projected/05adccff-76f7-4fea-be8c-c85db638c6ed-kube-api-access-jcmbv\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.026521 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.026429 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05adccff-76f7-4fea-be8c-c85db638c6ed-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.038455 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.038421 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-246k6"] Nov 04 06:01:14.127138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.127048 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05adccff-76f7-4fea-be8c-c85db638c6ed-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.127292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.127136 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9wzp\" (UniqueName: \"kubernetes.io/projected/9ab123bb-9978-4465-9ecc-d6ac6b646040-kube-api-access-v9wzp\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.127292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.127188 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab123bb-9978-4465-9ecc-d6ac6b646040-plugins-config-volume\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.127292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.127205 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcmbv\" (UniqueName: \"kubernetes.io/projected/05adccff-76f7-4fea-be8c-c85db638c6ed-kube-api-access-jcmbv\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.127877 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.127858 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05adccff-76f7-4fea-be8c-c85db638c6ed-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.192069 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.192030 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcmbv\" (UniqueName: \"kubernetes.io/projected/05adccff-76f7-4fea-be8c-c85db638c6ed-kube-api-access-jcmbv\") pod \"payload-pre-processing-7b98bb678c-sdjbp\" (UID: \"05adccff-76f7-4fea-be8c-c85db638c6ed\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.228015 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.227978 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9wzp\" (UniqueName: \"kubernetes.io/projected/9ab123bb-9978-4465-9ecc-d6ac6b646040-kube-api-access-v9wzp\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.228222 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.228039 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab123bb-9978-4465-9ecc-d6ac6b646040-plugins-config-volume\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.228817 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.228791 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab123bb-9978-4465-9ecc-d6ac6b646040-plugins-config-volume\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.292564 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.292529 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9wzp\" (UniqueName: \"kubernetes.io/projected/9ab123bb-9978-4465-9ecc-d6ac6b646040-kube-api-access-v9wzp\") pod \"payload-processing-7bb9489676-246k6\" (UID: \"9ab123bb-9978-4465-9ecc-d6ac6b646040\") " pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.329257 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.329220 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:14.455333 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.455294 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:14.713514 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.713478 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-246k6"] Nov 04 06:01:14.713856 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:01:14.713831 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab123bb_9978_4465_9ecc_d6ac6b646040.slice/crio-05c57aa040c4d5b45a4aa51f2fa9aea414fa295e55a192dce7e5da11f01d2c25 WatchSource:0}: Error finding container 05c57aa040c4d5b45a4aa51f2fa9aea414fa295e55a192dce7e5da11f01d2c25: Status 404 returned error can't find the container with id 05c57aa040c4d5b45a4aa51f2fa9aea414fa295e55a192dce7e5da11f01d2c25 Nov 04 06:01:14.738277 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.738246 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-246k6" event={"ID":"9ab123bb-9978-4465-9ecc-d6ac6b646040","Type":"ContainerStarted","Data":"05c57aa040c4d5b45a4aa51f2fa9aea414fa295e55a192dce7e5da11f01d2c25"} Nov 04 06:01:14.836391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:14.836361 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp"] Nov 04 06:01:14.836924 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:01:14.836900 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05adccff_76f7_4fea_be8c_c85db638c6ed.slice/crio-96c06033e240e83f600c7b899801cbfbbfb79f8b1f67aaef24a569c3be5fec4c WatchSource:0}: Error finding container 96c06033e240e83f600c7b899801cbfbbfb79f8b1f67aaef24a569c3be5fec4c: Status 404 returned error can't find the container with id 96c06033e240e83f600c7b899801cbfbbfb79f8b1f67aaef24a569c3be5fec4c Nov 04 06:01:15.748158 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:15.748124 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" event={"ID":"05adccff-76f7-4fea-be8c-c85db638c6ed","Type":"ContainerStarted","Data":"96c06033e240e83f600c7b899801cbfbbfb79f8b1f67aaef24a569c3be5fec4c"} Nov 04 06:01:17.380923 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:01:17.380856 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:01:17.762496 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:17.762450 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-246k6" event={"ID":"9ab123bb-9978-4465-9ecc-d6ac6b646040","Type":"ContainerStarted","Data":"16b068245871065bcd72a43018de0862e316246876bad9ba12c9050b74b15bca"} Nov 04 06:01:17.762679 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:17.762524 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:17.764394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:17.764368 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" event={"ID":"05adccff-76f7-4fea-be8c-c85db638c6ed","Type":"ContainerStarted","Data":"8f5ae6471c884b943fe83a58fc110ddd3164fb95aad938439ecb54a0c7a7dc8c"} Nov 04 06:01:17.764506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:17.764467 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:17.887131 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:17.887020 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-246k6" podStartSLOduration=2.082789193 podStartE2EDuration="4.887004844s" totalImagesPullingTime="2.804215651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:01:17.88506699 +0000 UTC m=+726.382461753" watchObservedRunningTime="2026-11-04 06:01:17.887004844 +0000 UTC m=+726.384399605" Nov 04 06:01:18.009687 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:18.009629 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" podStartSLOduration=2.228000172 podStartE2EDuration="5.009612076s" totalImagesPullingTime="2.781611904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:01:18.007192486 +0000 UTC m=+726.504587250" watchObservedRunningTime="2026-11-04 06:01:18.009612076 +0000 UTC m=+726.507006879" Nov 04 06:01:21.718536 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:21.718504 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:22.090793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.090674 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-c4d85ff99-nc79m"] Nov 04 06:01:22.094586 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.094565 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.155005 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.154973 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-c4d85ff99-nc79m"] Nov 04 06:01:22.194422 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.194390 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7qx\" (UniqueName: \"kubernetes.io/projected/359282ff-2f87-4b3d-b403-6f7340261992-kube-api-access-kc7qx\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.194556 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.194508 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/359282ff-2f87-4b3d-b403-6f7340261992-metrics-certs\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.295767 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.295706 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/359282ff-2f87-4b3d-b403-6f7340261992-metrics-certs\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.295930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.295808 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7qx\" (UniqueName: \"kubernetes.io/projected/359282ff-2f87-4b3d-b403-6f7340261992-kube-api-access-kc7qx\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.298129 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.298107 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/359282ff-2f87-4b3d-b403-6f7340261992-metrics-certs\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.360432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.360364 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7qx\" (UniqueName: \"kubernetes.io/projected/359282ff-2f87-4b3d-b403-6f7340261992-kube-api-access-kc7qx\") pod \"ai-gateway-controller-c4d85ff99-nc79m\" (UID: \"359282ff-2f87-4b3d-b403-6f7340261992\") " pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.407404 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.407371 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:22.786435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:22.786405 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-c4d85ff99-nc79m"] Nov 04 06:01:22.787882 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:01:22.787852 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359282ff_2f87_4b3d_b403_6f7340261992.slice/crio-40bac44399eadb9f1df993f49cfcd190182c7a9d395ab77b6dc10e6312b44348 WatchSource:0}: Error finding container 40bac44399eadb9f1df993f49cfcd190182c7a9d395ab77b6dc10e6312b44348: Status 404 returned error can't find the container with id 40bac44399eadb9f1df993f49cfcd190182c7a9d395ab77b6dc10e6312b44348 Nov 04 06:01:23.798179 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:23.798151 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" event={"ID":"359282ff-2f87-4b3d-b403-6f7340261992","Type":"ContainerStarted","Data":"40bac44399eadb9f1df993f49cfcd190182c7a9d395ab77b6dc10e6312b44348"} Nov 04 06:01:24.805239 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:24.805203 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" event={"ID":"359282ff-2f87-4b3d-b403-6f7340261992","Type":"ContainerStarted","Data":"321ed892605fb4f1bf0408d9e57e5b2f5f7220c251baee0d67d3062bd3312b53"} Nov 04 06:01:24.805662 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:24.805267 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:24.930526 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:24.930472 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" podStartSLOduration=1.9720872200000001 podStartE2EDuration="2.930457069s" totalImagesPullingTime="958.369849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:01:24.928357038 +0000 UTC m=+733.425751801" watchObservedRunningTime="2026-11-04 06:01:24.930457069 +0000 UTC m=+733.427851833" Nov 04 06:01:28.773989 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:28.773959 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp" Nov 04 06:01:28.774408 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:28.774025 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-246k6" Nov 04 06:01:35.813862 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:35.813826 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-c4d85ff99-nc79m" Nov 04 06:01:35.994154 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:35.994111 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:35.994431 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:35.994387 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" podUID="b535e99b-3ca1-4336-971a-3116675274b1" containerName="manager" containerID="cri-o://34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393" gracePeriod=30 Nov 04 06:01:36.250537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.250505 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:36.312912 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.312872 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\" (UniqueName: \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\") pod \"b535e99b-3ca1-4336-971a-3116675274b1\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " Nov 04 06:01:36.313105 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.313028 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\") pod \"b535e99b-3ca1-4336-971a-3116675274b1\" (UID: \"b535e99b-3ca1-4336-971a-3116675274b1\") " Nov 04 06:01:36.315202 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.315171 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs" pod "b535e99b-3ca1-4336-971a-3116675274b1" (UID: "b535e99b-3ca1-4336-971a-3116675274b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:01:36.315291 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.315248 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5" pod "b535e99b-3ca1-4336-971a-3116675274b1" (UID: "b535e99b-3ca1-4336-971a-3116675274b1"). InnerVolumeSpecName "kube-api-access-qnkw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:01:36.414196 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.414109 4932 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b535e99b-3ca1-4336-971a-3116675274b1-metrics-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:01:36.414196 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.414145 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnkw5\" (UniqueName: \"kubernetes.io/projected/b535e99b-3ca1-4336-971a-3116675274b1-kube-api-access-qnkw5\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:01:36.887369 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.887328 4932 generic.go:356] "Generic (PLEG): container finished" podID="b535e99b-3ca1-4336-971a-3116675274b1" containerID="34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393" exitCode=0 Nov 04 06:01:36.887832 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.887377 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" Nov 04 06:01:36.887832 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.887405 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" event={"ID":"b535e99b-3ca1-4336-971a-3116675274b1","Type":"ContainerDied","Data":"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393"} Nov 04 06:01:36.887832 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.887479 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7958bf97d9-b55f4" event={"ID":"b535e99b-3ca1-4336-971a-3116675274b1","Type":"ContainerDied","Data":"e5ca23a6f3548c93aba3b67dafbd9b505883081fb8f90e8ee9937a9272903602"} Nov 04 06:01:36.887832 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.887513 4932 scope.go:122] "RemoveContainer" containerID="34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393" Nov 04 06:01:36.898152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.898127 4932 scope.go:122] "RemoveContainer" containerID="34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393" Nov 04 06:01:36.898451 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:01:36.898432 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393\": container with ID starting with 34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393 not found: ID does not exist" containerID="34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393" Nov 04 06:01:36.898512 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:36.898460 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393"} err="failed to get container status \"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393\": rpc error: code = NotFound desc = could not find container \"34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393\": container with ID starting with 34fb0d0faedaf00e63ac0f06b68f8e17deafedc9a31cfe2ce2dc3666815b7393 not found: ID does not exist" Nov 04 06:01:37.064562 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:37.064527 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:37.118077 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:37.118044 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7958bf97d9-b55f4"] Nov 04 06:01:37.617135 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:01:37.617099 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b535e99b-3ca1-4336-971a-3116675274b1" path="/var/lib/kubelet/pods/b535e99b-3ca1-4336-971a-3116675274b1/volumes" Nov 04 06:01:47.368888 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:01:47.368850 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:02:12.158477 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.158401 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:02:12.159045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.159016 4932 cpu_manager.go:414] "containerMap: removing container" podUID="b535e99b-3ca1-4336-971a-3116675274b1" containerName="manager" Nov 04 06:02:12.159045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.159043 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b535e99b-3ca1-4336-971a-3116675274b1" containerName="manager" Nov 04 06:02:12.159225 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.159200 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="b535e99b-3ca1-4336-971a-3116675274b1" containerName="manager" Nov 04 06:02:12.163780 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.163759 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.238746 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.238698 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f38f69-openshift-default-dockercfg-4859w\"" Nov 04 06:02:12.294006 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.293972 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:02:12.344543 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344508 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344551 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344569 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344627 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344872 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344713 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344872 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344763 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfc48\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344872 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344784 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344967 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344881 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.344967 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.344914 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.445968 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.445882 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.445968 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.445940 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.445974 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446011 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446052 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446176 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446401 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446223 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446401 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446333 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446401 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446382 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfc48\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446626 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446458 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446626 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446536 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446626 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446551 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446812 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446707 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.446981 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.446958 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.448419 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.448389 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.448792 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.448770 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.510695 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.510663 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.510873 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.510843 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfc48\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.559285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.559257 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:02:12.564014 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.563994 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.631754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.620117 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-18990c-openshift-default-dockercfg-w6vqn\"" Nov 04 06:02:12.631754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.628951 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:02:12.749335 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749292 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749345 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749420 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749450 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749480 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9v9\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749545 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749626 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749707 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.749793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.749747 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.776652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.776624 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:12.850633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850601 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850653 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850676 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850693 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850713 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9v9\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850764 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.850795 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850784 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851119 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850832 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851119 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.850852 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851226 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.851187 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851408 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.851384 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851636 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.851613 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.851749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.851643 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.852071 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.852046 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.853397 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.853369 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.853628 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.853609 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.916480 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.916443 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:12.916625 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:12.916516 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9v9\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\") pod \"e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:13.178356 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.178270 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:13.219922 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.219887 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:02:13.259207 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:13.259175 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca435b0f_68ae_49f9_a6d9_70a264c2eeed.slice/crio-c811d8184d36ab1c30a897e1c0c3534ec5f573ff17eb88519f58effe1dcbc233 WatchSource:0}: Error finding container c811d8184d36ab1c30a897e1c0c3534ec5f573ff17eb88519f58effe1dcbc233: Status 404 returned error can't find the container with id c811d8184d36ab1c30a897e1c0c3534ec5f573ff17eb88519f58effe1dcbc233 Nov 04 06:02:13.261573 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.261536 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.261687 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.261605 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.261687 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.261632 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.268404 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.266394 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:02:13.272925 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.272904 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.338788 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.329586 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-db31ef-openshift-default-dockercfg-v5k8n\"" Nov 04 06:02:13.340700 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.340674 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:02:13.456791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456695 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.456791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456756 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.456791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456784 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949s6\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456842 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456873 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456891 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456937 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456962 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.457060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.456994 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558005 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.557972 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558017 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558044 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558084 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558108 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558134 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558426 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558166 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558426 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558195 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558426 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558230 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-949s6\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558426 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558417 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558670 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558613 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.558822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558798 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.559005 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.558985 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.559071 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.559053 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.560955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.560931 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.561419 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.561397 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.571677 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.571654 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:02:13.572583 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:13.572558 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e39787_663f_4340_b4ae_62350a29f75b.slice/crio-1fc2bbb8bd7aec1e7d6d432397b06be04c21be42c72a35d2dc2fd432f8cd6524 WatchSource:0}: Error finding container 1fc2bbb8bd7aec1e7d6d432397b06be04c21be42c72a35d2dc2fd432f8cd6524: Status 404 returned error can't find the container with id 1fc2bbb8bd7aec1e7d6d432397b06be04c21be42c72a35d2dc2fd432f8cd6524 Nov 04 06:02:13.575041 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.575012 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.575119 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.575070 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.575119 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.575109 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:13.618175 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.617980 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:02:13.623038 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.623017 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.629780 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.629754 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.630271 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.630246 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949s6\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.630466 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.630436 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:13.681290 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.680914 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777549 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777631 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777665 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777776 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777805 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777877 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67h6h\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777912 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777942 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.777974 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.795790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.779072 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-6b62c0-openshift-default-dockercfg-zkd6q\"" Nov 04 06:02:13.879016 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.878983 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879026 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879078 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67h6h\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879116 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879144 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879478 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879298 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879478 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879359 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879591 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879501 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879591 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879549 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.879848 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.879828 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.880035 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.880013 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.880103 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.880077 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.880163 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.880127 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.880211 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.880159 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.881625 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.881604 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.881707 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.881663 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.943861 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.943815 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.944020 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.943832 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67h6h\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:13.971864 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:13.971829 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:14.069064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.062961 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:02:14.078008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.077531 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.078008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.077592 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.078008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.077621 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.109581 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.109545 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerStarted","Data":"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3"} Nov 04 06:02:14.109758 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.109610 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerStarted","Data":"c811d8184d36ab1c30a897e1c0c3534ec5f573ff17eb88519f58effe1dcbc233"} Nov 04 06:02:14.112073 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.112042 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerStarted","Data":"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2"} Nov 04 06:02:14.112173 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.112094 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerStarted","Data":"1fc2bbb8bd7aec1e7d6d432397b06be04c21be42c72a35d2dc2fd432f8cd6524"} Nov 04 06:02:14.113619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.113593 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerStarted","Data":"8d48f527210bede6336d3f5d15fbed44b19e8437446c88b92ebf2e169f68e4b4"} Nov 04 06:02:14.179513 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.179479 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:14.185651 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.185623 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:14.237519 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.237406 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podStartSLOduration=2.237389298 podStartE2EDuration="2.237389298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:14.236305155 +0000 UTC m=+782.733699910" watchObservedRunningTime="2026-11-04 06:02:14.237389298 +0000 UTC m=+782.734784062" Nov 04 06:02:14.395557 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.392057 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podStartSLOduration=2.392037575 podStartE2EDuration="2.392037575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:14.384485343 +0000 UTC m=+782.881880108" watchObservedRunningTime="2026-11-04 06:02:14.392037575 +0000 UTC m=+782.889432340" Nov 04 06:02:14.395557 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.395168 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:02:14.404717 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:14.404689 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a25c1d_8e92_40b6_8094_8b54f9ef37ba.slice/crio-1ce20bb0725a386a70bb072558d8d77d28cfcc3d46e98bb109af4fa2f31824d5 WatchSource:0}: Error finding container 1ce20bb0725a386a70bb072558d8d77d28cfcc3d46e98bb109af4fa2f31824d5: Status 404 returned error can't find the container with id 1ce20bb0725a386a70bb072558d8d77d28cfcc3d46e98bb109af4fa2f31824d5 Nov 04 06:02:14.407556 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.407517 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.407679 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.407585 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.407679 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.407615 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:14.777560 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.777474 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:14.783020 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:14.782995 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:15.122117 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.122024 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerStarted","Data":"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6"} Nov 04 06:02:15.122117 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.122092 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerStarted","Data":"1ce20bb0725a386a70bb072558d8d77d28cfcc3d46e98bb109af4fa2f31824d5"} Nov 04 06:02:15.123811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.123781 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerStarted","Data":"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626"} Nov 04 06:02:15.124089 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.124061 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:15.124373 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.124352 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:15.125129 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.125107 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:02:15.125232 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.125168 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:15.265830 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.254680 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podStartSLOduration=2.254660966 podStartE2EDuration="2.254660966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:15.252109498 +0000 UTC m=+783.749504263" watchObservedRunningTime="2026-11-04 06:02:15.254660966 +0000 UTC m=+783.752055733" Nov 04 06:02:15.507871 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.507820 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podStartSLOduration=2.50780653 podStartE2EDuration="2.50780653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:15.505482249 +0000 UTC m=+784.002877013" watchObservedRunningTime="2026-11-04 06:02:15.50780653 +0000 UTC m=+784.005201293" Nov 04 06:02:15.661309 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.658965 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:15.665593 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.665562 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:15.972805 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.972775 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:15.978264 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:15.978240 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:16.130469 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:16.130438 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:16.130661 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:16.130495 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:16.131130 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:16.131112 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:02:16.131198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:16.131167 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:17.369375 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:02:17.369330 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:02:21.894493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:21.894462 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:02:21.899286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:21.899267 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:21.956415 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:21.956376 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-856c68\"" Nov 04 06:02:21.995519 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:21.995477 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:21.995694 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:21.995632 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zc6\" (UniqueName: \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.021500 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.021466 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-856c68-dockercfg-72g84\"" Nov 04 06:02:22.035745 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.032214 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:02:22.041534 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.041499 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:02:22.049752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.047258 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.097315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.097279 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.097537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.097516 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.097627 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.097596 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkgk\" (UniqueName: \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.097686 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.097667 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zc6\" (UniqueName: \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.098890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.098864 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.101218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.101191 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:02:22.165527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.165448 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zc6\" (UniqueName: \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\") pod \"payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.199063 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.199028 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.199213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.199109 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkgk\" (UniqueName: \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.199764 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.199713 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.216305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.216279 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:22.263512 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.263485 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkgk\" (UniqueName: \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\") pod \"payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.409179 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.409144 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:22.600849 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.600824 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:02:22.602512 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:22.602482 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0826f9bd_a6f0_4dda_ad85_47e2ccb388c2.slice/crio-a13150454bdbed6cb3b4e629a9313ac2a725c65d30aac1aed58bb09d589d507d WatchSource:0}: Error finding container a13150454bdbed6cb3b4e629a9313ac2a725c65d30aac1aed58bb09d589d507d: Status 404 returned error can't find the container with id a13150454bdbed6cb3b4e629a9313ac2a725c65d30aac1aed58bb09d589d507d Nov 04 06:02:22.792472 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:22.792446 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:02:22.793261 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:22.793239 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753e8405_d2a6_47ea_b1e0_a80db94ee61f.slice/crio-a25dc915ad7c09cb825f06fd38fece05edfdf76368521734b7738d1bec6fe3ff WatchSource:0}: Error finding container a25dc915ad7c09cb825f06fd38fece05edfdf76368521734b7738d1bec6fe3ff: Status 404 returned error can't find the container with id a25dc915ad7c09cb825f06fd38fece05edfdf76368521734b7738d1bec6fe3ff Nov 04 06:02:23.183823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.183714 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" event={"ID":"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2","Type":"ContainerStarted","Data":"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974"} Nov 04 06:02:23.183823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.183798 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" event={"ID":"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2","Type":"ContainerStarted","Data":"a13150454bdbed6cb3b4e629a9313ac2a725c65d30aac1aed58bb09d589d507d"} Nov 04 06:02:23.184267 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.183833 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:23.185380 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.185359 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" event={"ID":"753e8405-d2a6-47ea-b1e0-a80db94ee61f","Type":"ContainerStarted","Data":"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576"} Nov 04 06:02:23.185499 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.185394 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" event={"ID":"753e8405-d2a6-47ea-b1e0-a80db94ee61f","Type":"ContainerStarted","Data":"a25dc915ad7c09cb825f06fd38fece05edfdf76368521734b7738d1bec6fe3ff"} Nov 04 06:02:23.185499 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.185435 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:23.306259 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.306203 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" podStartSLOduration=2.306191626 podStartE2EDuration="2.306191626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:23.305940734 +0000 UTC m=+791.803335497" watchObservedRunningTime="2026-11-04 06:02:23.306191626 +0000 UTC m=+791.803586390" Nov 04 06:02:23.438389 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:23.438068 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" podStartSLOduration=2.438045973 podStartE2EDuration="2.438045973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:23.434066337 +0000 UTC m=+791.931461102" watchObservedRunningTime="2026-11-04 06:02:23.438045973 +0000 UTC m=+791.935440737" Nov 04 06:02:30.058198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.058146 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:02:30.062061 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.062044 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.182752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.173211 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-32f7d6\"" Nov 04 06:02:30.182752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.175906 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-32f7d6-dockercfg-9jqjg\"" Nov 04 06:02:30.182752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.179152 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:02:30.196771 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.193522 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.196771 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.193645 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqm9b\" (UniqueName: \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.210616 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.210568 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:02:30.216221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.216184 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.256254 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.256220 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:02:30.294841 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.294803 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqm9b\" (UniqueName: \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.295009 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.294978 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.295059 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.295031 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4nm9\" (UniqueName: \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.295131 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.295114 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.295668 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.295647 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.359323 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.359258 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqm9b\" (UniqueName: \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\") pod \"payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.376321 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.376295 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:30.396639 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.396612 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4nm9\" (UniqueName: \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.396786 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.396669 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.397568 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.397545 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.461675 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.461641 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4nm9\" (UniqueName: \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\") pod \"payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.532276 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.532250 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:30.757110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.757085 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:02:30.757964 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:30.757936 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cec0a6_f1a2_47c3_921b_346209ba1eb6.slice/crio-d80edbecec0d3233672cd722662485532ef2d34254744dc45783597bfcfd5d4e WatchSource:0}: Error finding container d80edbecec0d3233672cd722662485532ef2d34254744dc45783597bfcfd5d4e: Status 404 returned error can't find the container with id d80edbecec0d3233672cd722662485532ef2d34254744dc45783597bfcfd5d4e Nov 04 06:02:30.913103 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:30.913069 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:02:30.914177 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:30.914148 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2032a4_a785_4f0c_9ce6_915d8e1ec2e6.slice/crio-60bd8ed3f63ea8f91eed0223dad77426a91646dcbe624b8a1e30716148a3da61 WatchSource:0}: Error finding container 60bd8ed3f63ea8f91eed0223dad77426a91646dcbe624b8a1e30716148a3da61: Status 404 returned error can't find the container with id 60bd8ed3f63ea8f91eed0223dad77426a91646dcbe624b8a1e30716148a3da61 Nov 04 06:02:31.236781 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.236717 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" event={"ID":"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6","Type":"ContainerStarted","Data":"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52"} Nov 04 06:02:31.237264 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.236802 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" event={"ID":"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6","Type":"ContainerStarted","Data":"60bd8ed3f63ea8f91eed0223dad77426a91646dcbe624b8a1e30716148a3da61"} Nov 04 06:02:31.237264 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.236830 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:31.238485 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.238460 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" event={"ID":"42cec0a6-f1a2-47c3-921b-346209ba1eb6","Type":"ContainerStarted","Data":"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87"} Nov 04 06:02:31.238595 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.238505 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" event={"ID":"42cec0a6-f1a2-47c3-921b-346209ba1eb6","Type":"ContainerStarted","Data":"d80edbecec0d3233672cd722662485532ef2d34254744dc45783597bfcfd5d4e"} Nov 04 06:02:31.238595 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.238564 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:31.365281 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.365061 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" podStartSLOduration=1.3650423 podStartE2EDuration="1.3650423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:31.363295841 +0000 UTC m=+799.860690607" watchObservedRunningTime="2026-11-04 06:02:31.3650423 +0000 UTC m=+799.862437064" Nov 04 06:02:31.491350 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:31.491244 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" podStartSLOduration=1.491226298 podStartE2EDuration="1.491226298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:31.489014116 +0000 UTC m=+799.986408881" watchObservedRunningTime="2026-11-04 06:02:31.491226298 +0000 UTC m=+799.988621078" Nov 04 06:02:34.194482 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:34.194450 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:02:34.194924 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:34.194628 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:02:37.976954 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:37.976919 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:02:37.980825 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:37.980809 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.040887 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.040854 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:02:38.076642 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.076163 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.076642 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.076269 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225zv\" (UniqueName: \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.111904 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.111862 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-18990c\"" Nov 04 06:02:38.112226 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.112210 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-18990c-dockercfg-h7mdt\"" Nov 04 06:02:38.158920 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.158888 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:02:38.162821 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.162801 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.177134 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.177103 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.177247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.177146 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225zv\" (UniqueName: \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.178223 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.178191 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.180129 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.180103 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:02:38.241997 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.241919 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-225zv\" (UniqueName: \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\") pod \"payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.278484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.278451 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.278656 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.278608 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvk5w\" (UniqueName: \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.295045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.295010 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:38.379683 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.379646 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvk5w\" (UniqueName: \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.379815 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.379767 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.380692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.380667 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.444365 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.444329 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvk5w\" (UniqueName: \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\") pod \"payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.476207 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.476172 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:38.684420 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:38.684394 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode871cddd_d411_41ee_a7b0_af6af0e101d9.slice/crio-3aec1539f03013f14bd8e493d6f6ee63e3e4bf4f2a50f7473eba49d026dcda56 WatchSource:0}: Error finding container 3aec1539f03013f14bd8e493d6f6ee63e3e4bf4f2a50f7473eba49d026dcda56: Status 404 returned error can't find the container with id 3aec1539f03013f14bd8e493d6f6ee63e3e4bf4f2a50f7473eba49d026dcda56 Nov 04 06:02:38.684546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.684493 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:02:38.869885 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:38.869853 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:02:38.870399 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:38.870361 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6253218_1d97_4cbb_89a3_e2fbfad5bbb5.slice/crio-a7b9ca01eb837ef7ec2de0bcc396fc590b7741d54669fc3d1c9ec145d1517255 WatchSource:0}: Error finding container a7b9ca01eb837ef7ec2de0bcc396fc590b7741d54669fc3d1c9ec145d1517255: Status 404 returned error can't find the container with id a7b9ca01eb837ef7ec2de0bcc396fc590b7741d54669fc3d1c9ec145d1517255 Nov 04 06:02:39.300050 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.300015 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" event={"ID":"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5","Type":"ContainerStarted","Data":"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae"} Nov 04 06:02:39.300493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.300065 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" event={"ID":"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5","Type":"ContainerStarted","Data":"a7b9ca01eb837ef7ec2de0bcc396fc590b7741d54669fc3d1c9ec145d1517255"} Nov 04 06:02:39.300493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.300138 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:39.301716 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.301690 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" event={"ID":"e871cddd-d411-41ee-a7b0-af6af0e101d9","Type":"ContainerStarted","Data":"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8"} Nov 04 06:02:39.301865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.301752 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" event={"ID":"e871cddd-d411-41ee-a7b0-af6af0e101d9","Type":"ContainerStarted","Data":"3aec1539f03013f14bd8e493d6f6ee63e3e4bf4f2a50f7473eba49d026dcda56"} Nov 04 06:02:39.301865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.301824 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:39.425148 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.425097 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" podStartSLOduration=1.425083603 podStartE2EDuration="1.425083603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:39.42239088 +0000 UTC m=+807.919785645" watchObservedRunningTime="2026-11-04 06:02:39.425083603 +0000 UTC m=+807.922478367" Nov 04 06:02:39.555251 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:39.555132 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" podStartSLOduration=2.555113635 podStartE2EDuration="2.555113635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:39.552163961 +0000 UTC m=+808.049558726" watchObservedRunningTime="2026-11-04 06:02:39.555113635 +0000 UTC m=+808.052508401" Nov 04 06:02:40.836902 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.836867 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:02:40.840853 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.840833 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:40.897657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.897628 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-356418\"" Nov 04 06:02:40.901046 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.901021 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:02:40.907388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.907351 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbbd\" (UniqueName: \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:40.907538 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.907518 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:40.954112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.954067 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-356418-dockercfg-rxfrk\"" Nov 04 06:02:40.992918 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.991878 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:02:40.996462 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:40.996433 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.008659 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.008635 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:41.008797 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.008747 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbbd\" (UniqueName: \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:41.009317 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.009297 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:41.039367 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.039336 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:02:41.073484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.073456 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbbd\" (UniqueName: \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\") pod \"payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:41.109463 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.109395 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.109463 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.109443 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rzt8\" (UniqueName: \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.154621 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.154592 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:41.210685 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.210655 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.210844 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.210707 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rzt8\" (UniqueName: \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.211665 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.211640 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.275791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.275752 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rzt8\" (UniqueName: \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\") pod \"payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.309125 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.309093 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:41.537060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.537033 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:02:41.537341 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:41.537314 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0752c5_37a4_4ad8_801b_1d5a14b690b1.slice/crio-c00651de4417af5e4901dbea2f21dfd7f581751e9efd9411700b26ca57becae3 WatchSource:0}: Error finding container c00651de4417af5e4901dbea2f21dfd7f581751e9efd9411700b26ca57becae3: Status 404 returned error can't find the container with id c00651de4417af5e4901dbea2f21dfd7f581751e9efd9411700b26ca57becae3 Nov 04 06:02:41.691119 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:41.691080 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9143134_590e_4a8d_a6d1_c7045e669969.slice/crio-25577f47ad919608b76185c7b49824fd9e8ae7c1ab850c28ef3839eeb04e714c WatchSource:0}: Error finding container 25577f47ad919608b76185c7b49824fd9e8ae7c1ab850c28ef3839eeb04e714c: Status 404 returned error can't find the container with id 25577f47ad919608b76185c7b49824fd9e8ae7c1ab850c28ef3839eeb04e714c Nov 04 06:02:41.691347 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:41.691323 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:02:42.247880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.247849 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:02:42.248283 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.247929 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:02:42.322224 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.322186 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" event={"ID":"0f0752c5-37a4-4ad8-801b-1d5a14b690b1","Type":"ContainerStarted","Data":"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c"} Nov 04 06:02:42.322384 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.322251 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" event={"ID":"0f0752c5-37a4-4ad8-801b-1d5a14b690b1","Type":"ContainerStarted","Data":"c00651de4417af5e4901dbea2f21dfd7f581751e9efd9411700b26ca57becae3"} Nov 04 06:02:42.322384 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.322281 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:42.323778 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.323751 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" event={"ID":"a9143134-590e-4a8d-a6d1-c7045e669969","Type":"ContainerStarted","Data":"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712"} Nov 04 06:02:42.323880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.323795 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" event={"ID":"a9143134-590e-4a8d-a6d1-c7045e669969","Type":"ContainerStarted","Data":"25577f47ad919608b76185c7b49824fd9e8ae7c1ab850c28ef3839eeb04e714c"} Nov 04 06:02:42.323880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.323813 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:42.626546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.626414 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" podStartSLOduration=2.626395645 podStartE2EDuration="2.626395645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:42.616453462 +0000 UTC m=+811.113848226" watchObservedRunningTime="2026-11-04 06:02:42.626395645 +0000 UTC m=+811.123790410" Nov 04 06:02:42.744242 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:42.744183 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" podStartSLOduration=2.744169406 podStartE2EDuration="2.744169406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:42.741181282 +0000 UTC m=+811.238576073" watchObservedRunningTime="2026-11-04 06:02:42.744169406 +0000 UTC m=+811.241564169" Nov 04 06:02:46.246266 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.246231 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:02:46.250392 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.250371 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.366088 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.366052 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-6b62c0-dockercfg-mv5pk\"" Nov 04 06:02:46.379932 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.379901 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-6b62c0\"" Nov 04 06:02:46.396794 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.396675 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:02:46.399016 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.398989 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.399182 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.399039 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26lfn\" (UniqueName: \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.500100 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.500017 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.500358 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.500335 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26lfn\" (UniqueName: \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.500971 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.500947 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.565518 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.565490 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26lfn\" (UniqueName: \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\") pod \"payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:46.864377 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:46.864286 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:47.246290 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:47.246262 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:02:47.247377 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:47.247349 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8d6929_5056_47c8_8424_35989c743d96.slice/crio-4b3fbe4b42ee4dd51cf7084ebfd18b8d63478585b17488cc60ee5b487dd8a839 WatchSource:0}: Error finding container 4b3fbe4b42ee4dd51cf7084ebfd18b8d63478585b17488cc60ee5b487dd8a839: Status 404 returned error can't find the container with id 4b3fbe4b42ee4dd51cf7084ebfd18b8d63478585b17488cc60ee5b487dd8a839 Nov 04 06:02:47.364375 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:47.364336 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" event={"ID":"de8d6929-5056-47c8-8424-35989c743d96","Type":"ContainerStarted","Data":"de1ccd548fdf6b55e6777e418b8d705fae7aee529fdab6296ef57cf374ecd940"} Nov 04 06:02:47.364536 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:47.364403 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" event={"ID":"de8d6929-5056-47c8-8424-35989c743d96","Type":"ContainerStarted","Data":"4b3fbe4b42ee4dd51cf7084ebfd18b8d63478585b17488cc60ee5b487dd8a839"} Nov 04 06:02:47.364604 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:47.364568 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:47.374580 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:02:47.374551 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:02:47.492819 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:47.489897 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" podStartSLOduration=1.489876464 podStartE2EDuration="1.489876464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:47.488114078 +0000 UTC m=+815.985508842" watchObservedRunningTime="2026-11-04 06:02:47.489876464 +0000 UTC m=+815.987271229" Nov 04 06:02:49.158880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.144231 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:02:49.163065 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.163036 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.177721 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.177694 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdpw\" (UniqueName: \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.177835 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.177823 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.260763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.251870 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:02:49.281764 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.281303 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdpw\" (UniqueName: \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.281764 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.281436 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.297798 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.297746 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-db31ef-dockercfg-7nbhf\"" Nov 04 06:02:49.297989 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.297872 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-db31ef\"" Nov 04 06:02:49.298501 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.298423 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:02:49.329748 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.306400 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.388549 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.378673 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.458481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.405638 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.458481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.405681 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d565v\" (UniqueName: \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.458481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.443503 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:02:49.472673 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.472638 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdpw\" (UniqueName: \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\") pod \"payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.478924 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.478901 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:49.564337 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.564300 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.564567 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.564547 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d565v\" (UniqueName: \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.565742 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.565698 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.657356 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.656431 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d565v\" (UniqueName: \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\") pod \"payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:49.776071 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:49.776044 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:50.047635 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.047485 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:02:50.058744 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:02:50.058703 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04e9516_c1bb_4645_8730_12a1bffa593d.slice/crio-ecbd8a68e5901cd0353be5267f1764909872f56038f82553cfc46270f071f0c6 WatchSource:0}: Error finding container ecbd8a68e5901cd0353be5267f1764909872f56038f82553cfc46270f071f0c6: Status 404 returned error can't find the container with id ecbd8a68e5901cd0353be5267f1764909872f56038f82553cfc46270f071f0c6 Nov 04 06:02:50.231752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.228856 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:02:50.344826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.343851 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:02:50.345210 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.345191 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:02:50.453161 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.453128 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" event={"ID":"64c88e0a-7571-40ce-abce-97dec74c05a3","Type":"ContainerStarted","Data":"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec"} Nov 04 06:02:50.453328 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.453180 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" event={"ID":"64c88e0a-7571-40ce-abce-97dec74c05a3","Type":"ContainerStarted","Data":"f0846a8f184651884d03c07e36fafbe351ba166000a762b74682959f1178d84a"} Nov 04 06:02:50.453535 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.453488 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:02:50.455665 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.455164 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" event={"ID":"d04e9516-c1bb-4645-8730-12a1bffa593d","Type":"ContainerStarted","Data":"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f"} Nov 04 06:02:50.455665 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.455203 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" event={"ID":"d04e9516-c1bb-4645-8730-12a1bffa593d","Type":"ContainerStarted","Data":"ecbd8a68e5901cd0353be5267f1764909872f56038f82553cfc46270f071f0c6"} Nov 04 06:02:50.455665 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.455636 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:02:50.648804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.646099 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" podStartSLOduration=1.646079135 podStartE2EDuration="1.646079135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:50.604103728 +0000 UTC m=+819.101498514" watchObservedRunningTime="2026-11-04 06:02:50.646079135 +0000 UTC m=+819.143473940" Nov 04 06:02:50.773845 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:50.773653 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" podStartSLOduration=1.773633915 podStartE2EDuration="1.773633915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:50.772500926 +0000 UTC m=+819.269895692" watchObservedRunningTime="2026-11-04 06:02:50.773633915 +0000 UTC m=+819.271028694" Nov 04 06:02:53.333623 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:53.333591 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:02:53.334154 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:53.333900 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:02:57.507225 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.507190 4932 generic.go:356] "Generic (PLEG): container finished" podID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerID="6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3" exitCode=0 Nov 04 06:02:57.507813 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.507266 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerDied","Data":"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3"} Nov 04 06:02:57.507813 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.507697 4932 scope.go:122] "RemoveContainer" containerID="6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3" Nov 04 06:02:57.509114 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509081 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.509204 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509162 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.509243 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509200 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.509243 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509204 4932 generic.go:356] "Generic (PLEG): container finished" podID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerID="f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626" exitCode=0 Nov 04 06:02:57.509314 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509282 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerDied","Data":"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626"} Nov 04 06:02:57.509641 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.509610 4932 scope.go:122] "RemoveContainer" containerID="f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626" Nov 04 06:02:57.510904 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.510871 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.511054 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.510942 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.511054 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.510980 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:57.808265 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.808179 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:02:57.811162 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.811138 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.908929 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.908894 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:02:57.910446 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910409 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910606 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910457 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910606 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910489 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910718 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910684 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910789 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910773 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910830 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910810 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910881 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910833 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910881 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910874 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkq22\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:57.910977 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:57.910904 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012012 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.011968 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012215 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012025 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012215 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012145 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012215 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012177 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012218 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkq22\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012248 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012334 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012359 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012388 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012631 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012432 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.012759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.012717 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.013079 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.013053 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.013557 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.013530 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.013866 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.013845 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.014718 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.014685 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.015534 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.015508 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.081823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.081358 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkq22\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.081823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.081521 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.125763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.125393 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:02:58.375953 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.374536 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:02:58.584702 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.584654 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerStarted","Data":"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0"} Nov 04 06:02:58.587998 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.587968 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerStarted","Data":"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5"} Nov 04 06:02:58.641805 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.639220 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:02:58.641805 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.640019 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:02:58.641805 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.640066 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:02:58.704429 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.704392 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:02:58.763793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.763191 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:58.763793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.763289 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:58.763793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.763330 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:02:58.776888 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.776866 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:02:58.778077 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.778053 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:02:58.778174 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:58.778096 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:02:59.644450 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.644411 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:02:59.645094 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.645046 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:02:59.746753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.738972 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" event={"ID":"3336d0e3-a277-48aa-afc7-88d4f1b16aa9","Type":"ContainerStarted","Data":"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9"} Nov 04 06:02:59.746753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.739032 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" event={"ID":"3336d0e3-a277-48aa-afc7-88d4f1b16aa9","Type":"ContainerStarted","Data":"f4f3d00c193a350551f9926541a8a05ce038b42ecbd7df8a47f6f671a60f9cda"} Nov 04 06:02:59.782858 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.781388 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:02:59.782858 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.781456 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:02:59.879694 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:02:59.879631 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podStartSLOduration=2.879617075 podStartE2EDuration="2.879617075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:59.876881351 +0000 UTC m=+828.374276119" watchObservedRunningTime="2026-11-04 06:02:59.879617075 +0000 UTC m=+828.377011839" Nov 04 06:03:00.125750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.124840 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:03:00.129762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.128155 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:03:00.129762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.128298 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:00.129762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.128343 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:00.631186 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.631150 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:03:00.631447 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.631407 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:03:00.777250 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.777218 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:03:00.777818 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:00.777787 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:03:01.133749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.132485 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:01.133749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.132569 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:01.133749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.132820 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:03:01.484706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.484675 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:03:01.631750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.631183 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:03:01.631750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.631247 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:03:01.932086 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.931988 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:03:01.932684 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:01.932634 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:03:02.130675 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.130640 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:02.134972 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.134937 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:02.479281 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.478877 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:03:02.682249 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.682172 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:03:02.682249 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.682236 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:03:02.777290 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.777192 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:03:02.777556 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:02.777511 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:03:03.137811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.130174 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:03.137811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.130241 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:03.647185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.647148 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 06:03:03.647452 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.647426 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 06:03:03.777006 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.776972 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 06:03:03.777208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:03.777029 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 06:03:04.129177 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.129138 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:04.129473 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.129443 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:04.635738 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.635695 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:03:04.636770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.636748 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:03:04.781500 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.781470 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:03:04.782430 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:04.782410 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:03:05.126874 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:05.126846 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 06:03:05.127125 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:05.127101 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 06:03:06.130872 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:06.130835 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:03:06.131372 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:06.131232 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:03:06.131978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:06.131958 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:03:17.370206 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:03:17.370162 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:03:21.090016 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.089976 4932 generic.go:356] "Generic (PLEG): container finished" podID="68e39787-663f-4340-b4ae-62350a29f75b" containerID="b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2" exitCode=0 Nov 04 06:03:21.090716 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.090186 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerDied","Data":"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2"} Nov 04 06:03:21.091245 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.091221 4932 scope.go:122] "RemoveContainer" containerID="b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2" Nov 04 06:03:21.092721 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.092691 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:21.092882 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.092788 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:21.092882 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:21.092839 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:22.126494 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:22.126454 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerStarted","Data":"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f"} Nov 04 06:03:22.178673 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:22.178637 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:03:22.178883 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:22.178861 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:22.178948 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:22.178918 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:23.178860 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:23.178785 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:23.178860 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:23.178838 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:24.178908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:24.178876 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:24.179365 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:24.179334 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:25.178784 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:25.178747 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:25.178991 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:25.178830 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:26.179402 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:26.179372 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:26.179812 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:26.179426 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:27.178636 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:27.178600 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 06:03:27.178825 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:27.178664 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 06:03:28.184411 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:28.184375 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:03:28.184951 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:28.184765 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:03:28.185822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:28.185787 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:03:32.171928 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:32.171878 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 06:03:32.172352 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:32.171961 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 06:03:33.220619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.220589 4932 generic.go:356] "Generic (PLEG): container finished" podID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerID="9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6" exitCode=0 Nov 04 06:03:33.221187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.220668 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerDied","Data":"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6"} Nov 04 06:03:33.221187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.221158 4932 scope.go:122] "RemoveContainer" containerID="9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6" Nov 04 06:03:33.222692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.222659 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:33.222830 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.222759 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:33.222830 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:33.222804 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:03:34.230674 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:34.230640 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerStarted","Data":"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb"} Nov 04 06:03:34.972308 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:34.972275 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:03:34.972501 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:34.972454 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Nov 04 06:03:34.972573 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:34.972508 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Nov 04 06:03:35.972775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:35.972718 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Nov 04 06:03:35.973160 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:35.972823 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Nov 04 06:03:36.972925 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:36.972884 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Nov 04 06:03:36.973423 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:36.972945 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Nov 04 06:03:37.972581 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:37.972547 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Nov 04 06:03:37.972771 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:37.972605 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Nov 04 06:03:38.973969 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:38.973932 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Nov 04 06:03:38.974563 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:38.974531 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Nov 04 06:03:39.976655 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:39.976619 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:03:39.977106 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:39.977046 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:03:39.977559 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:03:39.977542 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:03:47.370035 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:03:47.369991 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:04:11.743821 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:11.743789 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 06:04:11.745690 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:11.745668 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 06:04:17.370189 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:04:17.370154 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:04:27.670947 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.670906 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:04:27.674592 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.674569 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.709836 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.709789 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.710013 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.709886 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq6q7\" (UniqueName: \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.710013 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.709943 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.710013 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.709977 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.710013 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.710004 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.710261 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.710036 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.736377 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.736344 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:04:27.783058 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.783028 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"openshift-service-ca.crt\"" Nov 04 06:04:27.783058 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.783028 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"kube-root-ca.crt\"" Nov 04 06:04:27.783267 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.783135 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"default-dockercfg-xtn25\"" Nov 04 06:04:27.790527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.790504 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"premium-w4-856c68-kserve-self-signed-certs\"" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831269 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831367 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq6q7\" (UniqueName: \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831423 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831460 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831485 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.831517 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.832750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.832082 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.833425 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.833398 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.834286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.833897 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.858801 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.856162 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.859440 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.859412 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:27.898682 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:27.898650 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq6q7\" (UniqueName: \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\") pod \"premium-w4-856c68-kserve-6cc9b49448-q2zmd\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:28.005682 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:28.005648 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:28.425646 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:28.425619 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:04:28.426225 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:04:28.426201 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00f26db9_e080_44d8_959a_3b7dba9fe4c6.slice/crio-e0e97f816f6d5cc9c9cace6969e55ae2f72d4e53b2591560ae53e39f47fe61fd WatchSource:0}: Error finding container e0e97f816f6d5cc9c9cace6969e55ae2f72d4e53b2591560ae53e39f47fe61fd: Status 404 returned error can't find the container with id e0e97f816f6d5cc9c9cace6969e55ae2f72d4e53b2591560ae53e39f47fe61fd Nov 04 06:04:28.597565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:28.597528 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" event={"ID":"00f26db9-e080-44d8-959a-3b7dba9fe4c6","Type":"ContainerStarted","Data":"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded"} Nov 04 06:04:28.597565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:28.597570 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" event={"ID":"00f26db9-e080-44d8-959a-3b7dba9fe4c6","Type":"ContainerStarted","Data":"e0e97f816f6d5cc9c9cace6969e55ae2f72d4e53b2591560ae53e39f47fe61fd"} Nov 04 06:04:28.721495 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:28.721447 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" podStartSLOduration=1.721433534 podStartE2EDuration="1.721433534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:28.721171307 +0000 UTC m=+917.218566072" watchObservedRunningTime="2026-11-04 06:04:28.721433534 +0000 UTC m=+917.218828335" Nov 04 06:04:29.006506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:29.006418 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:38.006735 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:38.006679 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:38.020059 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:38.020033 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:38.686129 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:38.686093 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:04:47.370996 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:04:47.370954 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:04:57.727228 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.727137 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:04:57.731570 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.731546 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.793252 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.793196 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:04:57.843323 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.843285 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"openshift-service-ca.crt\"" Nov 04 06:04:57.843510 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.843339 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"default-dockercfg-zgpp6\"" Nov 04 06:04:57.843510 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.843358 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"kube-root-ca.crt\"" Nov 04 06:04:57.843510 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.843449 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"premium-w0-f38f69-kserve-self-signed-certs\"" Nov 04 06:04:57.870655 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.870609 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.870863 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.870715 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9l7\" (UniqueName: \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.870945 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.870862 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.870945 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.870909 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.870945 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.870936 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.871184 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.871030 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972161 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972129 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9l7\" (UniqueName: \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972220 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972265 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972289 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972455 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972355 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972455 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972426 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972721 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972699 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972848 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972762 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.972950 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.972850 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.974527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.974506 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:57.974810 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:57.974790 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:58.036823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.036722 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9l7\" (UniqueName: \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\") pod \"premium-w0-f38f69-kserve-7dcc5cb54b-66llz\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:58.044565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.044539 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:58.306960 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.306872 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:04:58.314369 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.314340 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.370666 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.370626 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-856c68-openshift-default-dockercfg-fv7lh\"" Nov 04 06:04:58.372209 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.372178 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:04:58.446697 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:04:58.446666 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefcaf78b_e143_4700_8cd0_a1aa2533d6e9.slice/crio-af2e25e9a81bc8a04de0676e88c0969e244d4d4b516f09c237dce1510a0e0571 WatchSource:0}: Error finding container af2e25e9a81bc8a04de0676e88c0969e244d4d4b516f09c237dce1510a0e0571: Status 404 returned error can't find the container with id af2e25e9a81bc8a04de0676e88c0969e244d4d4b516f09c237dce1510a0e0571 Nov 04 06:04:58.447718 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.447697 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:04:58.476872 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.476847 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.476973 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.476892 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.476973 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.476917 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.476999 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.477035 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.477126 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477179 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.477154 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zfkc\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.477192 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.477288 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.477277 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578000 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578047 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zfkc\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578099 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578165 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578201 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578251 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578275 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578561 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578304 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578561 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578331 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578561 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578439 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578774 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578717 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.578987 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.578761 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.579157 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.579135 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.579484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.579452 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.580778 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.580756 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.581176 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.581154 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.642782 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.642753 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.642938 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.642855 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zfkc\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.820458 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.820416 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" event={"ID":"efcaf78b-e143-4700-8cd0-a1aa2533d6e9","Type":"ContainerStarted","Data":"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0"} Nov 04 06:04:58.820849 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.820466 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" event={"ID":"efcaf78b-e143-4700-8cd0-a1aa2533d6e9","Type":"ContainerStarted","Data":"af2e25e9a81bc8a04de0676e88c0969e244d4d4b516f09c237dce1510a0e0571"} Nov 04 06:04:58.929424 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.929345 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:58.945891 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:58.945848 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" podStartSLOduration=1.945832995 podStartE2EDuration="1.945832995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:58.943448233 +0000 UTC m=+947.440842998" watchObservedRunningTime="2026-11-04 06:04:58.945832995 +0000 UTC m=+947.443227759" Nov 04 06:04:59.045515 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.045471 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:04:59.371770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.371739 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:04:59.371905 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:04:59.371881 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23379c91_82be_4eb2_81e0_f6332bc74467.slice/crio-f032f732fac07cd680b58334a9a868aa5a98b2871d81c4f61638f620b275f593 WatchSource:0}: Error finding container f032f732fac07cd680b58334a9a868aa5a98b2871d81c4f61638f620b275f593: Status 404 returned error can't find the container with id f032f732fac07cd680b58334a9a868aa5a98b2871d81c4f61638f620b275f593 Nov 04 06:04:59.374709 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.374677 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:04:59.374806 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.374778 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:04:59.374856 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.374816 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:04:59.830790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.830750 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" event={"ID":"23379c91-82be-4eb2-81e0-f6332bc74467","Type":"ContainerStarted","Data":"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54"} Nov 04 06:04:59.831200 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.830813 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" event={"ID":"23379c91-82be-4eb2-81e0-f6332bc74467","Type":"ContainerStarted","Data":"f032f732fac07cd680b58334a9a868aa5a98b2871d81c4f61638f620b275f593"} Nov 04 06:04:59.930412 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.930382 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:04:59.961111 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:04:59.961048 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podStartSLOduration=1.9610340389999998 podStartE2EDuration="1.961034039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:59.957653141 +0000 UTC m=+948.455047906" watchObservedRunningTime="2026-11-04 06:04:59.961034039 +0000 UTC m=+948.458428803" Nov 04 06:05:00.931984 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:00.931938 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:00.932484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:00.932008 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:01.929931 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:01.929891 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:01.930119 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:01.929954 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:02.929860 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:02.929826 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:02.930226 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:02.929880 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:03.930330 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:03.930293 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:03.930767 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:03.930350 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:04.930007 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:04.929970 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:04.930157 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:04.930024 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:05.930582 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:05.930543 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 04 06:05:05.930986 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:05.930614 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 04 06:05:06.933969 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:06.933937 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:05:06.934413 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:06.934395 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:05:06.935172 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:06.935153 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:05:08.045580 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:08.045540 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:05:08.058234 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:08.058209 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:05:08.904569 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:05:08.904538 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:05:17.370769 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:05:17.370702 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:05:47.370595 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:05:47.370549 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:06:17.370415 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:06:17.370371 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:06:24.485222 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.485185 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:06:24.489189 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.489166 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.551007 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.550974 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:06:24.599915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.599857 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"kube-root-ca.crt\"" Nov 04 06:06:24.600109 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.600090 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"default-dockercfg-v58b7\"" Nov 04 06:06:24.600178 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.600091 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"openshift-service-ca.crt\"" Nov 04 06:06:24.602298 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.602284 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"premium-w5-6b62c0-kserve-self-signed-certs\"" Nov 04 06:06:24.632568 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632537 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.632568 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632570 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.632804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632596 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.632804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632674 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.632894 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632810 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.632894 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.632887 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qhn5\" (UniqueName: \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.735660 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.735561 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qhn5\" (UniqueName: \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.736279 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.736244 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.736417 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.736284 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.736417 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.736366 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.736417 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.736403 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.736595 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.736555 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.737366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.737335 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.737366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.737356 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.737700 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.737672 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.739879 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.739846 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.740156 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.740138 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.800665 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.800634 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qhn5\" (UniqueName: \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\") pod \"premium-w5-6b62c0-kserve-69c94cb556-gwkbg\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:24.801318 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:24.801292 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:25.250827 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:06:25.250703 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c71c07f_bf79_4ae6_aa7b_cde912b35a6f.slice/crio-907c44464793f8ac582f0a104408928b9ea6c9c1ac60d0e6d81981191916a908 WatchSource:0}: Error finding container 907c44464793f8ac582f0a104408928b9ea6c9c1ac60d0e6d81981191916a908: Status 404 returned error can't find the container with id 907c44464793f8ac582f0a104408928b9ea6c9c1ac60d0e6d81981191916a908 Nov 04 06:06:25.250939 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:25.250841 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:06:25.442204 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:25.442171 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" event={"ID":"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f","Type":"ContainerStarted","Data":"1b171b9df1e3668609fe6c01344129c4707c24b4388bed4cff94b48cd6db7047"} Nov 04 06:06:25.442357 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:25.442210 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" event={"ID":"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f","Type":"ContainerStarted","Data":"907c44464793f8ac582f0a104408928b9ea6c9c1ac60d0e6d81981191916a908"} Nov 04 06:06:25.567201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:25.567087 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" podStartSLOduration=1.567068829 podStartE2EDuration="1.567068829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:06:25.565349784 +0000 UTC m=+1034.062744547" watchObservedRunningTime="2026-11-04 06:06:25.567068829 +0000 UTC m=+1034.064463593" Nov 04 06:06:25.802141 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:25.802113 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:34.802313 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:34.802274 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:34.814373 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:34.814347 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:35.518589 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:35.518555 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:06:43.297256 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:43.297213 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 06:06:43.297762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:43.297445 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" containerID="cri-o://ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878" gracePeriod=30 Nov 04 06:06:47.371261 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:06:47.371223 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:06:48.547960 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.547936 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 06:06:48.614644 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.614563 4932 generic.go:356] "Generic (PLEG): container finished" podID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerID="ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878" exitCode=0 Nov 04 06:06:48.614644 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.614594 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" Nov 04 06:06:48.614644 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.614635 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerDied","Data":"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878"} Nov 04 06:06:48.614899 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.614687 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f" event={"ID":"04e4e943-4a9c-463f-a22a-b69e58a7b65a","Type":"ContainerDied","Data":"4de8d22110d57290af98cb3e5b2598d44f09b5acf0ad84f1547029a0245a0138"} Nov 04 06:06:48.614899 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.614719 4932 scope.go:122] "RemoveContainer" containerID="ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878" Nov 04 06:06:48.625882 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.625862 4932 scope.go:122] "RemoveContainer" containerID="4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47" Nov 04 06:06:48.637477 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637452 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637625 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637511 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637625 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637553 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637625 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637585 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637624 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637669 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637684 4932 scope.go:122] "RemoveContainer" containerID="ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878" Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637737 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637765 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637789 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.637878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637813 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:06:48.638191 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637890 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\") pod \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\" (UID: \"04e4e943-4a9c-463f-a22a-b69e58a7b65a\") " Nov 04 06:06:48.638191 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.637909 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:06:48.638285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638184 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:06:48.638285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638214 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:06:48.638394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638329 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.638394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638345 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.638394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638362 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.638394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638376 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.638394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638390 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.638642 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:06:48.638584 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878\": container with ID starting with ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878 not found: ID does not exist" containerID="ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878" Nov 04 06:06:48.638642 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638616 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878"} err="failed to get container status \"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878\": rpc error: code = NotFound desc = could not find container \"ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878\": container with ID starting with ded94f05236f8cb681b3448e03a83da91db8b6d69ef1586451364ff4d5b2c878 not found: ID does not exist" Nov 04 06:06:48.638642 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.638635 4932 scope.go:122] "RemoveContainer" containerID="4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47" Nov 04 06:06:48.638993 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:06:48.638960 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47\": container with ID starting with 4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47 not found: ID does not exist" containerID="4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47" Nov 04 06:06:48.639108 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.639002 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47"} err="failed to get container status \"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47\": rpc error: code = NotFound desc = could not find container \"4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47\": container with ID starting with 4e4e986bd92fa50db3acf882f69a25cee03a07e3f12fa94416dae78d39d7bb47 not found: ID does not exist" Nov 04 06:06:48.640235 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.640210 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:06:48.640235 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.640215 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "kube-api-access-hmkf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:06:48.640399 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.640319 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:06:48.640399 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.640378 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token" pod "04e4e943-4a9c-463f-a22a-b69e58a7b65a" (UID: "04e4e943-4a9c-463f-a22a-b69e58a7b65a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:06:48.739802 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.739692 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.739802 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.739742 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.739802 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.739759 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmkf4\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-kube-api-access-hmkf4\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:48.739802 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:48.739772 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e4e943-4a9c-463f-a22a-b69e58a7b65a-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:06:49.050457 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:49.050419 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 06:06:49.055315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:49.055285 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f"] Nov 04 06:06:49.618344 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:06:49.618305 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" path="/var/lib/kubelet/pods/04e4e943-4a9c-463f-a22a-b69e58a7b65a/volumes" Nov 04 06:07:02.705605 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.705570 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:07:02.706362 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706340 4932 cpu_manager.go:414] "containerMap: removing container" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.706459 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706364 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.706459 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706420 4932 cpu_manager.go:414] "containerMap: removing container" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.706459 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706429 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.706606 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706575 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.706606 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.706594 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="04e4e943-4a9c-463f-a22a-b69e58a7b65a" containerName="istio-proxy" Nov 04 06:07:02.709959 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.709938 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.800986 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.800949 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.800986 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.800992 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.801231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.801132 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.801231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.801172 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d5p\" (UniqueName: \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.801338 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.801317 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.801392 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.801364 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.819719 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.819687 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"distinct-w4-856c68-kserve-self-signed-certs\"" Nov 04 06:07:02.823142 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.823119 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:07:02.906286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906246 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.906286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906299 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.906565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906410 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.906565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906453 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d5p\" (UniqueName: \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.906565 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906551 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.906752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.906584 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.907221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.907193 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.907956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.907600 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.907956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.907888 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.909227 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.909185 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.910334 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.910312 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:02.972262 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:02.972225 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d5p\" (UniqueName: \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\") pod \"distinct-w4-856c68-kserve-77476f847-6d84h\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:03.021597 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:03.021551 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:03.407525 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:03.407492 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:07:03.407934 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:03.407910 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a38d712_f7a0_41c0_b069_7fb05f086470.slice/crio-161a66adfe10b63db9974d00189bf97c1a3bd8408d2f98d300f8eb69240295b7 WatchSource:0}: Error finding container 161a66adfe10b63db9974d00189bf97c1a3bd8408d2f98d300f8eb69240295b7: Status 404 returned error can't find the container with id 161a66adfe10b63db9974d00189bf97c1a3bd8408d2f98d300f8eb69240295b7 Nov 04 06:07:03.723939 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:03.723901 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" event={"ID":"9a38d712-f7a0-41c0-b069-7fb05f086470","Type":"ContainerStarted","Data":"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc"} Nov 04 06:07:03.724425 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:03.723953 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" event={"ID":"9a38d712-f7a0-41c0-b069-7fb05f086470","Type":"ContainerStarted","Data":"161a66adfe10b63db9974d00189bf97c1a3bd8408d2f98d300f8eb69240295b7"} Nov 04 06:07:03.849822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:03.849767 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" podStartSLOduration=1.849751787 podStartE2EDuration="1.849751787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:03.847366677 +0000 UTC m=+1072.344761441" watchObservedRunningTime="2026-11-04 06:07:03.849751787 +0000 UTC m=+1072.347146551" Nov 04 06:07:04.022526 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:04.022443 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:13.021905 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:13.021858 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:13.036575 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:13.036547 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:13.807074 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:13.807042 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:07:15.487864 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.487832 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:07:15.493065 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.493045 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546332 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546290 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546332 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546338 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546521 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546360 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lsb2\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546521 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546411 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546594 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546533 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546594 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546581 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546607 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546745 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546706 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.546787 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.546763 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.613756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.602958 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-32f7d6-openshift-default-dockercfg-vgfph\"" Nov 04 06:07:15.613756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.608567 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:07:15.647529 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647488 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.647737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647539 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.647737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647617 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.647737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647651 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.647737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647685 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lsb2\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.647737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647713 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.648019 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647832 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.648019 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647931 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.648019 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.647991 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.648414 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.648384 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.650424 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.650394 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.650570 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.650550 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.650633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.650609 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.650775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.650748 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.650998 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.650975 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.651124 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.651107 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.713654 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.713619 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.713804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.713699 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lsb2\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:15.809608 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:15.809509 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:16.251409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.251379 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:07:16.251983 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:16.251955 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e25ae2_db0a_4745_bc85_cdf4819b380f.slice/crio-e621662d87466155ad6c549cf617da58b75d7771d18f55f66711b053d47fff67 WatchSource:0}: Error finding container e621662d87466155ad6c549cf617da58b75d7771d18f55f66711b053d47fff67: Status 404 returned error can't find the container with id e621662d87466155ad6c549cf617da58b75d7771d18f55f66711b053d47fff67 Nov 04 06:07:16.254218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.254185 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:16.254301 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.254248 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:16.254301 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.254281 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:16.820585 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.820549 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" event={"ID":"e4e25ae2-db0a-4745-bc85-cdf4819b380f","Type":"ContainerStarted","Data":"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df"} Nov 04 06:07:16.821134 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.820610 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" event={"ID":"e4e25ae2-db0a-4745-bc85-cdf4819b380f","Type":"ContainerStarted","Data":"e621662d87466155ad6c549cf617da58b75d7771d18f55f66711b053d47fff67"} Nov 04 06:07:16.948353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:16.948287 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podStartSLOduration=1.948266687 podStartE2EDuration="1.948266687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:16.947157619 +0000 UTC m=+1085.444552401" watchObservedRunningTime="2026-11-04 06:07:16.948266687 +0000 UTC m=+1085.445661452" Nov 04 06:07:17.371377 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:07:17.371337 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:07:17.817608 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:17.812113 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:17.821633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:17.820991 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:17.821633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:17.821051 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:18.811091 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:18.811054 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:18.811420 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:18.811391 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:19.825547 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:19.824990 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:19.825547 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:19.825066 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:20.811069 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:20.811032 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:20.811336 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:20.811306 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:21.811136 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:21.811085 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:21.811773 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:21.811738 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:22.810138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:22.810100 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 04 06:07:22.810318 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:22.810166 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 04 06:07:23.816532 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:23.816497 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:23.817043 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:23.817021 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:23.817790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:23.817771 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:07:36.588001 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.587963 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285"] Nov 04 06:07:36.592132 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.592112 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.655326 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.655299 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285"] Nov 04 06:07:36.703710 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.703680 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:07:36.703890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.703761 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:07:36.732737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.732690 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.732908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.732765 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqggp\" (UniqueName: \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.732908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.732843 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.834191 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.834157 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.834361 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.834201 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqggp\" (UniqueName: \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.834361 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.834232 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.834831 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.834803 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.836585 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.836564 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.899189 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.899115 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqggp\" (UniqueName: \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\") pod \"maas-api-revoke-sub-9cbd57c5-kr285\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:36.906065 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:36.906041 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:37.298187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:37.298146 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285"] Nov 04 06:07:37.298848 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:37.298816 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5730bb_17fa_431f_8a6a_ab06cf46470a.slice/crio-e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6 WatchSource:0}: Error finding container e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6: Status 404 returned error can't find the container with id e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6 Nov 04 06:07:37.982881 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:37.982838 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" event={"ID":"2d5730bb-17fa-431f-8a6a-ab06cf46470a","Type":"ContainerStarted","Data":"6e606c04d84a6c082e5cc48664da5303d5c4f84e9c58f40454b632fabc3e39aa"} Nov 04 06:07:37.983353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:37.982910 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" event={"ID":"2d5730bb-17fa-431f-8a6a-ab06cf46470a","Type":"ContainerStarted","Data":"e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6"} Nov 04 06:07:38.106581 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.106528 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" podStartSLOduration=2.106511459 podStartE2EDuration="2.106511459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:38.105439435 +0000 UTC m=+1106.602834222" watchObservedRunningTime="2026-11-04 06:07:38.106511459 +0000 UTC m=+1106.603906270" Nov 04 06:07:38.273566 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.273473 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7"] Nov 04 06:07:38.277528 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.277508 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.349008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.348970 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.355198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.355161 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hq2\" (UniqueName: \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.355365 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.355279 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.356255 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.356037 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7"] Nov 04 06:07:38.456135 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.456100 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.456135 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.456143 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hq2\" (UniqueName: \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.456400 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.456173 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.456891 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.456865 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.458519 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.458498 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.522052 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.522020 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hq2\" (UniqueName: \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\") pod \"maas-api-revoke-sub-65c9ad2a-fd5p7\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.591633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.591546 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:38.978059 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.978029 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7"] Nov 04 06:07:38.978185 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:38.978048 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe190aa_d3fd_4e38_ada2_a1c09bec5559.slice/crio-cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389 WatchSource:0}: Error finding container cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389: Status 404 returned error can't find the container with id cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389 Nov 04 06:07:38.992532 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.992498 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" event={"ID":"8fe190aa-d3fd-4e38-ada2-a1c09bec5559","Type":"ContainerStarted","Data":"cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389"} Nov 04 06:07:38.994525 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.994498 4932 generic.go:356] "Generic (PLEG): container finished" podID="2d5730bb-17fa-431f-8a6a-ab06cf46470a" containerID="6e606c04d84a6c082e5cc48664da5303d5c4f84e9c58f40454b632fabc3e39aa" exitCode=0 Nov 04 06:07:38.994748 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:38.994635 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" event={"ID":"2d5730bb-17fa-431f-8a6a-ab06cf46470a","Type":"ContainerDied","Data":"6e606c04d84a6c082e5cc48664da5303d5c4f84e9c58f40454b632fabc3e39aa"} Nov 04 06:07:40.003877 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.003846 4932 generic.go:356] "Generic (PLEG): container finished" podID="8fe190aa-d3fd-4e38-ada2-a1c09bec5559" containerID="9f7787505e59be4c08731247d25bb096585f64f5557e7c445c751954654da53e" exitCode=0 Nov 04 06:07:40.004273 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.003915 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" event={"ID":"8fe190aa-d3fd-4e38-ada2-a1c09bec5559","Type":"ContainerDied","Data":"9f7787505e59be4c08731247d25bb096585f64f5557e7c445c751954654da53e"} Nov 04 06:07:40.144265 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.144239 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:40.277272 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.277235 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\") pod \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " Nov 04 06:07:40.277464 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.277317 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\") pod \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " Nov 04 06:07:40.277464 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.277350 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\" (UniqueName: \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\") pod \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\" (UID: \"2d5730bb-17fa-431f-8a6a-ab06cf46470a\") " Nov 04 06:07:40.277865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.277835 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca" pod "2d5730bb-17fa-431f-8a6a-ab06cf46470a" (UID: "2d5730bb-17fa-431f-8a6a-ab06cf46470a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:40.279944 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.279905 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca" pod "2d5730bb-17fa-431f-8a6a-ab06cf46470a" (UID: "2d5730bb-17fa-431f-8a6a-ab06cf46470a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:40.280246 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.280219 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp" pod "2d5730bb-17fa-431f-8a6a-ab06cf46470a" (UID: "2d5730bb-17fa-431f-8a6a-ab06cf46470a"). InnerVolumeSpecName "kube-api-access-hqggp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:40.379323 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.379287 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:40.379323 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.379316 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d5730bb-17fa-431f-8a6a-ab06cf46470a-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:40.379323 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.379327 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqggp\" (UniqueName: \"kubernetes.io/projected/2d5730bb-17fa-431f-8a6a-ab06cf46470a-kube-api-access-hqggp\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:40.850690 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.850651 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz"] Nov 04 06:07:40.851294 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.851273 4932 cpu_manager.go:414] "containerMap: removing container" podUID="2d5730bb-17fa-431f-8a6a-ab06cf46470a" containerName="revoke-keys" Nov 04 06:07:40.851402 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.851294 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d5730bb-17fa-431f-8a6a-ab06cf46470a" containerName="revoke-keys" Nov 04 06:07:40.851490 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.851477 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d5730bb-17fa-431f-8a6a-ab06cf46470a" containerName="revoke-keys" Nov 04 06:07:40.854977 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.854957 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:40.915037 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.914997 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz"] Nov 04 06:07:40.986209 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.986168 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq865\" (UniqueName: \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:40.986378 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.986298 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:40.986378 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:40.986353 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.012305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.012279 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" Nov 04 06:07:41.012675 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.012322 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285" event={"ID":"2d5730bb-17fa-431f-8a6a-ab06cf46470a","Type":"ContainerDied","Data":"e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6"} Nov 04 06:07:41.012675 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.012368 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6a21ee414e78cd923bfec459b5591057129cfb65873ebff804351b760423de6" Nov 04 06:07:41.087228 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.087186 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.087397 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.087287 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.087480 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.087463 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq865\" (UniqueName: \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.088011 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.087986 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.089719 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.089695 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.153230 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.153202 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq865\" (UniqueName: \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\") pod \"maas-api-revoke-sub-f6f9ca18-vxwwz\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.179131 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.179091 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:41.218776 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.214041 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:41.391862 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.391776 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\") pod \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " Nov 04 06:07:41.392030 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.391866 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\") pod \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " Nov 04 06:07:41.392030 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.391901 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\" (UniqueName: \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\") pod \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\" (UID: \"8fe190aa-d3fd-4e38-ada2-a1c09bec5559\") " Nov 04 06:07:41.392198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.392174 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca" pod "8fe190aa-d3fd-4e38-ada2-a1c09bec5559" (UID: "8fe190aa-d3fd-4e38-ada2-a1c09bec5559"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:41.392409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.392392 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:41.393972 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.393941 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca" pod "8fe190aa-d3fd-4e38-ada2-a1c09bec5559" (UID: "8fe190aa-d3fd-4e38-ada2-a1c09bec5559"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:41.394094 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.394075 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2" pod "8fe190aa-d3fd-4e38-ada2-a1c09bec5559" (UID: "8fe190aa-d3fd-4e38-ada2-a1c09bec5559"). InnerVolumeSpecName "kube-api-access-t8hq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:41.493520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.493479 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:41.493520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.493509 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8hq2\" (UniqueName: \"kubernetes.io/projected/8fe190aa-d3fd-4e38-ada2-a1c09bec5559-kube-api-access-t8hq2\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:41.589819 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:41.589782 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz"] Nov 04 06:07:41.590127 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:41.590097 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d47996_5f12_4a43_9ad0_ce57d9f2e8c7.slice/crio-3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440 WatchSource:0}: Error finding container 3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440: Status 404 returned error can't find the container with id 3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440 Nov 04 06:07:42.021085 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.021054 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" Nov 04 06:07:42.021575 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.021091 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7" event={"ID":"8fe190aa-d3fd-4e38-ada2-a1c09bec5559","Type":"ContainerDied","Data":"cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389"} Nov 04 06:07:42.021575 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.021168 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cde0001c9b04fc4a8ecca11a2e42562c96a8cd12660231b2bd79a29ffb578389" Nov 04 06:07:42.023208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.023161 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" event={"ID":"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7","Type":"ContainerStarted","Data":"d6128afc6a47ff305629f44e13ae913cac462da01e03cf2aa7177160c2a190a5"} Nov 04 06:07:42.023371 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.023242 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" event={"ID":"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7","Type":"ContainerStarted","Data":"3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440"} Nov 04 06:07:42.145462 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:42.145402 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" podStartSLOduration=2.145388008 podStartE2EDuration="2.145388008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:42.14522364 +0000 UTC m=+1110.642618405" watchObservedRunningTime="2026-11-04 06:07:42.145388008 +0000 UTC m=+1110.642782772" Nov 04 06:07:43.032651 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.032614 4932 generic.go:356] "Generic (PLEG): container finished" podID="f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" containerID="d6128afc6a47ff305629f44e13ae913cac462da01e03cf2aa7177160c2a190a5" exitCode=0 Nov 04 06:07:43.033166 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.032703 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" event={"ID":"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7","Type":"ContainerDied","Data":"d6128afc6a47ff305629f44e13ae913cac462da01e03cf2aa7177160c2a190a5"} Nov 04 06:07:43.546116 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.546085 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn"] Nov 04 06:07:43.546657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.546644 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8fe190aa-d3fd-4e38-ada2-a1c09bec5559" containerName="revoke-keys" Nov 04 06:07:43.546705 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.546658 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe190aa-d3fd-4e38-ada2-a1c09bec5559" containerName="revoke-keys" Nov 04 06:07:43.546770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.546760 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fe190aa-d3fd-4e38-ada2-a1c09bec5559" containerName="revoke-keys" Nov 04 06:07:43.550194 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.550176 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.623301 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.623269 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn"] Nov 04 06:07:43.718162 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.718122 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.718386 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.718360 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.718456 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.718438 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvxv\" (UniqueName: \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.819915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.819824 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.819915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.819900 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.820141 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.819936 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvxv\" (UniqueName: \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.820623 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.820595 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.822335 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.822307 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:43.884533 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:43.884499 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvxv\" (UniqueName: \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\") pod \"maas-api-revoke-sub-dd400c80-qhldn\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:44.164276 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.164240 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:44.211998 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.211965 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:44.324049 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.324014 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\" (UniqueName: \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\") pod \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " Nov 04 06:07:44.324242 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.324061 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\") pod \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " Nov 04 06:07:44.324242 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.324119 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\") pod \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\" (UID: \"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7\") " Nov 04 06:07:44.324564 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.324534 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca" pod "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" (UID: "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:44.326330 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.326301 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca" pod "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" (UID: "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:44.326443 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.326324 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865" pod "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" (UID: "f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7"). InnerVolumeSpecName "kube-api-access-dq865". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:44.426144 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.426061 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:44.426144 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.426098 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq865\" (UniqueName: \"kubernetes.io/projected/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-kube-api-access-dq865\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:44.426144 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.426114 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:44.559346 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.559309 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn"] Nov 04 06:07:44.674432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.674400 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:07:44.674978 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.674964 4932 cpu_manager.go:414] "containerMap: removing container" podUID="f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" containerName="revoke-keys" Nov 04 06:07:44.675029 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.674979 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" containerName="revoke-keys" Nov 04 06:07:44.675106 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.675091 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" containerName="revoke-keys" Nov 04 06:07:44.679806 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.679759 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.770442 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.770411 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:07:44.830288 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830256 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830461 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830306 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830461 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830358 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830503 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830544 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830640 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830598 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830719 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830703 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830797 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.830861 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.830846 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksc98\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932117 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932362 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932210 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932362 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932241 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksc98\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932362 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932306 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932348 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932403 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932460 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932509 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932570 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932680 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.932954 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932935 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.933024 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.932981 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.933211 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.933161 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.933211 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.933159 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.934960 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.934935 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.935048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.934981 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.997330 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.997271 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksc98\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:44.997537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:44.997512 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:45.049231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.049200 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" Nov 04 06:07:45.049406 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.049235 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz" event={"ID":"f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7","Type":"ContainerDied","Data":"3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440"} Nov 04 06:07:45.049406 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.049288 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3008645ebc48681cb8b25f065d86f756d09096124ca708649f5c12ac4894f440" Nov 04 06:07:45.051063 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.051038 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" event={"ID":"701bdb8c-1d59-43c9-87f9-4d83a0dd425a","Type":"ContainerStarted","Data":"356f464b7b667bc63194e904ac0df14548585425d4162130f4a9ebc27711537e"} Nov 04 06:07:45.051198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.051074 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" event={"ID":"701bdb8c-1d59-43c9-87f9-4d83a0dd425a","Type":"ContainerStarted","Data":"5ab0c16c5db0de9b4f56e99cabf37eccae86301935c1aae0026cedae9fbf8e91"} Nov 04 06:07:45.174865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.174814 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" podStartSLOduration=2.174801268 podStartE2EDuration="2.174801268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:45.17339985 +0000 UTC m=+1113.670794610" watchObservedRunningTime="2026-11-04 06:07:45.174801268 +0000 UTC m=+1113.672196032" Nov 04 06:07:45.187768 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.187684 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:07:45.293406 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.293380 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:45.748680 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.748652 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:07:45.748940 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:45.748916 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c967bf0_4529_4be1_b3e2_06b24c63e3cf.slice/crio-0a74b6e17ff14dd09710efbe3409c2e5181557ad7d9afdbdde98937551c68f43 WatchSource:0}: Error finding container 0a74b6e17ff14dd09710efbe3409c2e5181557ad7d9afdbdde98937551c68f43: Status 404 returned error can't find the container with id 0a74b6e17ff14dd09710efbe3409c2e5181557ad7d9afdbdde98937551c68f43 Nov 04 06:07:45.751152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.751119 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:45.751213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.751183 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:45.751260 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:45.751216 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:07:46.061221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.061188 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" event={"ID":"1c967bf0-4529-4be1-b3e2-06b24c63e3cf","Type":"ContainerStarted","Data":"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930"} Nov 04 06:07:46.061408 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.061254 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" event={"ID":"1c967bf0-4529-4be1-b3e2-06b24c63e3cf","Type":"ContainerStarted","Data":"0a74b6e17ff14dd09710efbe3409c2e5181557ad7d9afdbdde98937551c68f43"} Nov 04 06:07:46.063060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.063032 4932 generic.go:356] "Generic (PLEG): container finished" podID="701bdb8c-1d59-43c9-87f9-4d83a0dd425a" containerID="356f464b7b667bc63194e904ac0df14548585425d4162130f4a9ebc27711537e" exitCode=0 Nov 04 06:07:46.063197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.063128 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" event={"ID":"701bdb8c-1d59-43c9-87f9-4d83a0dd425a","Type":"ContainerDied","Data":"356f464b7b667bc63194e904ac0df14548585425d4162130f4a9ebc27711537e"} Nov 04 06:07:46.190373 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.190321 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podStartSLOduration=2.190305632 podStartE2EDuration="2.190305632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:46.187892043 +0000 UTC m=+1114.685286819" watchObservedRunningTime="2026-11-04 06:07:46.190305632 +0000 UTC m=+1114.687700396" Nov 04 06:07:46.294128 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.294091 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:46.295717 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.295690 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:46.295863 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:46.295754 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:47.303820 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.300292 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:47.303820 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.300353 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:47.331838 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.331770 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:47.363967 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.363937 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\") pod \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " Nov 04 06:07:47.364120 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.364055 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\") pod \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " Nov 04 06:07:47.364214 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.364196 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\" (UniqueName: \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\") pod \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\" (UID: \"701bdb8c-1d59-43c9-87f9-4d83a0dd425a\") " Nov 04 06:07:47.364413 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.364390 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca" pod "701bdb8c-1d59-43c9-87f9-4d83a0dd425a" (UID: "701bdb8c-1d59-43c9-87f9-4d83a0dd425a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:47.364637 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.364616 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:47.366367 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.366338 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca" pod "701bdb8c-1d59-43c9-87f9-4d83a0dd425a" (UID: "701bdb8c-1d59-43c9-87f9-4d83a0dd425a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:47.366639 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.366611 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv" pod "701bdb8c-1d59-43c9-87f9-4d83a0dd425a" (UID: "701bdb8c-1d59-43c9-87f9-4d83a0dd425a"). InnerVolumeSpecName "kube-api-access-8pvxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:47.372712 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:07:47.372679 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:07:47.466435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.466402 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pvxv\" (UniqueName: \"kubernetes.io/projected/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-kube-api-access-8pvxv\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:47.466435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:47.466438 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/701bdb8c-1d59-43c9-87f9-4d83a0dd425a-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:48.079810 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:48.079775 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" Nov 04 06:07:48.079810 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:48.079772 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn" event={"ID":"701bdb8c-1d59-43c9-87f9-4d83a0dd425a","Type":"ContainerDied","Data":"5ab0c16c5db0de9b4f56e99cabf37eccae86301935c1aae0026cedae9fbf8e91"} Nov 04 06:07:48.080037 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:48.079847 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ab0c16c5db0de9b4f56e99cabf37eccae86301935c1aae0026cedae9fbf8e91" Nov 04 06:07:48.313937 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:48.313895 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:48.314762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:48.314706 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:49.308751 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:49.304930 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:49.308751 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:49.305005 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:50.301759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:50.298128 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:50.301759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:50.298189 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:51.307749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:51.299812 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:51.307749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:51.299873 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:52.293944 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:52.293903 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 04 06:07:52.294102 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:52.293978 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 04 06:07:53.298815 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.298762 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:53.299263 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.299025 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:53.299878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.299861 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:07:53.587716 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.587632 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7"] Nov 04 06:07:53.588292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.588271 4932 cpu_manager.go:414] "containerMap: removing container" podUID="701bdb8c-1d59-43c9-87f9-4d83a0dd425a" containerName="revoke-keys" Nov 04 06:07:53.588386 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.588294 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="701bdb8c-1d59-43c9-87f9-4d83a0dd425a" containerName="revoke-keys" Nov 04 06:07:53.588476 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.588462 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="701bdb8c-1d59-43c9-87f9-4d83a0dd425a" containerName="revoke-keys" Nov 04 06:07:53.592064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.592042 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.648991 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.648948 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:07:53.649231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.649038 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:07:53.652469 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.652442 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7"] Nov 04 06:07:53.672309 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.672283 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7cfm\" (UniqueName: \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.672455 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.672433 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.672539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.672468 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.773581 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.773554 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7cfm\" (UniqueName: \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.773783 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.773613 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.773783 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.773640 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.774386 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.774362 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.776080 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.776058 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.838386 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.838315 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7cfm\" (UniqueName: \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\") pod \"maas-api-revoke-sub-54752bc5-jckf7\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:53.905521 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:53.905496 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:54.289030 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:54.289002 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7"] Nov 04 06:07:54.289403 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:54.289379 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f57fad_66e0_442f_aa77_79bf2070adb9.slice/crio-892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c WatchSource:0}: Error finding container 892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c: Status 404 returned error can't find the container with id 892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c Nov 04 06:07:55.004752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.001551 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs"] Nov 04 06:07:55.017113 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.017086 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.050778 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.046529 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs"] Nov 04 06:07:55.089079 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.089044 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.089241 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.089093 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.089241 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.089121 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h664n\" (UniqueName: \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.145573 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.145531 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" event={"ID":"56f57fad-66e0-442f-aa77-79bf2070adb9","Type":"ContainerStarted","Data":"b6c7f329b31f1fa6d005252e710034916af5af4e915f471841c22bde38b69b07"} Nov 04 06:07:55.145738 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.145592 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" event={"ID":"56f57fad-66e0-442f-aa77-79bf2070adb9","Type":"ContainerStarted","Data":"892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c"} Nov 04 06:07:55.191066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.191035 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.191197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.191105 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.191197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.191185 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h664n\" (UniqueName: \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.191869 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.191846 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.193492 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.193468 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.256213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.256142 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h664n\" (UniqueName: \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\") pod \"maas-api-revoke-sub-6ca4e675-hqfxs\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.272329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.272280 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" podStartSLOduration=2.272265687 podStartE2EDuration="2.272265687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:55.268020562 +0000 UTC m=+1123.765415326" watchObservedRunningTime="2026-11-04 06:07:55.272265687 +0000 UTC m=+1123.769660450" Nov 04 06:07:55.350306 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.350272 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:55.757345 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.757314 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs"] Nov 04 06:07:55.757960 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:55.757931 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea84f429_8934_4729_bb89_783d9ab2afde.slice/crio-3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b WatchSource:0}: Error finding container 3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b: Status 404 returned error can't find the container with id 3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b Nov 04 06:07:55.918099 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.918065 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc"] Nov 04 06:07:55.923312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:55.923296 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.002005 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.001969 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.002185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.002036 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.002185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.002124 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct97q\" (UniqueName: \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.008953 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.008340 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc"] Nov 04 06:07:56.105754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.102971 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.105754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.103540 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.105754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.103681 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct97q\" (UniqueName: \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.105754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.104662 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.107823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.107763 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.159769 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.159712 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" event={"ID":"ea84f429-8934-4729-bb89-783d9ab2afde","Type":"ContainerStarted","Data":"3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b"} Nov 04 06:07:56.161670 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.161641 4932 generic.go:356] "Generic (PLEG): container finished" podID="56f57fad-66e0-442f-aa77-79bf2070adb9" containerID="b6c7f329b31f1fa6d005252e710034916af5af4e915f471841c22bde38b69b07" exitCode=0 Nov 04 06:07:56.161841 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.161685 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" event={"ID":"56f57fad-66e0-442f-aa77-79bf2070adb9","Type":"ContainerDied","Data":"b6c7f329b31f1fa6d005252e710034916af5af4e915f471841c22bde38b69b07"} Nov 04 06:07:56.168493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.168471 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct97q\" (UniqueName: \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\") pod \"maas-api-revoke-sub-67cff179-xg4gc\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.239704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.239675 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:56.627614 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:07:56.627584 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8315f1_33d2_40fe_bfda_859a13402885.slice/crio-f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6 WatchSource:0}: Error finding container f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6: Status 404 returned error can't find the container with id f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6 Nov 04 06:07:56.628165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.628139 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc"] Nov 04 06:07:56.711180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.711140 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:07:56.831486 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:56.831455 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:07:57.288088 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.288045 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" event={"ID":"8a8315f1-33d2-40fe-bfda-859a13402885","Type":"ContainerStarted","Data":"32cefcfb61ab4aa00db11ca182978ec4586d5f8514f849ffb48182337eca41f8"} Nov 04 06:07:57.288572 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.288114 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" event={"ID":"8a8315f1-33d2-40fe-bfda-859a13402885","Type":"ContainerStarted","Data":"f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6"} Nov 04 06:07:57.301977 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.296414 4932 generic.go:356] "Generic (PLEG): container finished" podID="ea84f429-8934-4729-bb89-783d9ab2afde" containerID="16dd6a877998fe04ce2345ca5a1ba0bb927400373deae900094479e95c41c472" exitCode=0 Nov 04 06:07:57.301977 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.296915 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" event={"ID":"ea84f429-8934-4729-bb89-783d9ab2afde","Type":"ContainerDied","Data":"16dd6a877998fe04ce2345ca5a1ba0bb927400373deae900094479e95c41c472"} Nov 04 06:07:57.417944 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.417858 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" podStartSLOduration=2.417836846 podStartE2EDuration="2.417836846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:57.414712489 +0000 UTC m=+1125.912107255" watchObservedRunningTime="2026-11-04 06:07:57.417836846 +0000 UTC m=+1125.915231611" Nov 04 06:07:57.488963 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.488941 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:57.565825 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.565750 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\") pod \"56f57fad-66e0-442f-aa77-79bf2070adb9\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " Nov 04 06:07:57.565952 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.565848 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\" (UniqueName: \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\") pod \"56f57fad-66e0-442f-aa77-79bf2070adb9\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " Nov 04 06:07:57.565952 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.565931 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\") pod \"56f57fad-66e0-442f-aa77-79bf2070adb9\" (UID: \"56f57fad-66e0-442f-aa77-79bf2070adb9\") " Nov 04 06:07:57.566266 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.566240 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca" pod "56f57fad-66e0-442f-aa77-79bf2070adb9" (UID: "56f57fad-66e0-442f-aa77-79bf2070adb9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:57.567896 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.567876 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca" pod "56f57fad-66e0-442f-aa77-79bf2070adb9" (UID: "56f57fad-66e0-442f-aa77-79bf2070adb9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:57.567973 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.567903 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm" pod "56f57fad-66e0-442f-aa77-79bf2070adb9" (UID: "56f57fad-66e0-442f-aa77-79bf2070adb9"). InnerVolumeSpecName "kube-api-access-f7cfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:57.667439 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.667411 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7cfm\" (UniqueName: \"kubernetes.io/projected/56f57fad-66e0-442f-aa77-79bf2070adb9-kube-api-access-f7cfm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:57.667439 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.667436 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:57.667628 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.667446 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56f57fad-66e0-442f-aa77-79bf2070adb9-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:57.987653 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.987619 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8"] Nov 04 06:07:57.988224 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.988210 4932 cpu_manager.go:414] "containerMap: removing container" podUID="56f57fad-66e0-442f-aa77-79bf2070adb9" containerName="revoke-keys" Nov 04 06:07:57.988283 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.988226 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f57fad-66e0-442f-aa77-79bf2070adb9" containerName="revoke-keys" Nov 04 06:07:57.988353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.988344 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f57fad-66e0-442f-aa77-79bf2070adb9" containerName="revoke-keys" Nov 04 06:07:57.991967 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:57.991947 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.052016 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.051988 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8"] Nov 04 06:07:58.071926 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.071899 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.072042 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.071935 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9r67\" (UniqueName: \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.072173 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.072148 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.173603 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.173570 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.173603 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.173604 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9r67\" (UniqueName: \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.173855 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.173777 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.174391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.174370 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.175904 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.175877 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.238590 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.238513 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9r67\" (UniqueName: \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\") pod \"maas-api-revoke-sub-a112906e-pd7q8\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.329444 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.322181 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:07:58.380759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.380024 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" event={"ID":"56f57fad-66e0-442f-aa77-79bf2070adb9","Type":"ContainerDied","Data":"892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c"} Nov 04 06:07:58.380759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.380103 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="892cfb18bf09849f10e77f30db8583e494ade3d4c241b1a3b4002eef2fec255c" Nov 04 06:07:58.380759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.380174 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7" Nov 04 06:07:58.397858 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.382845 4932 generic.go:356] "Generic (PLEG): container finished" podID="8a8315f1-33d2-40fe-bfda-859a13402885" containerID="32cefcfb61ab4aa00db11ca182978ec4586d5f8514f849ffb48182337eca41f8" exitCode=0 Nov 04 06:07:58.397858 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.383458 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" event={"ID":"8a8315f1-33d2-40fe-bfda-859a13402885","Type":"ContainerDied","Data":"32cefcfb61ab4aa00db11ca182978ec4586d5f8514f849ffb48182337eca41f8"} Nov 04 06:07:58.705378 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.704078 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:58.793234 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.793203 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8"] Nov 04 06:07:58.803419 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.803389 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\" (UniqueName: \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\") pod \"ea84f429-8934-4729-bb89-783d9ab2afde\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " Nov 04 06:07:58.803520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.803495 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\") pod \"ea84f429-8934-4729-bb89-783d9ab2afde\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " Nov 04 06:07:58.803619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.803601 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\") pod \"ea84f429-8934-4729-bb89-783d9ab2afde\" (UID: \"ea84f429-8934-4729-bb89-783d9ab2afde\") " Nov 04 06:07:58.804150 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.804122 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca" pod "ea84f429-8934-4729-bb89-783d9ab2afde" (UID: "ea84f429-8934-4729-bb89-783d9ab2afde"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:58.804306 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.804286 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.807836 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.806780 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n" pod "ea84f429-8934-4729-bb89-783d9ab2afde" (UID: "ea84f429-8934-4729-bb89-783d9ab2afde"). InnerVolumeSpecName "kube-api-access-h664n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:58.807836 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.806798 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca" pod "ea84f429-8934-4729-bb89-783d9ab2afde" (UID: "ea84f429-8934-4729-bb89-783d9ab2afde"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:58.905657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.905623 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h664n\" (UniqueName: \"kubernetes.io/projected/ea84f429-8934-4729-bb89-783d9ab2afde-kube-api-access-h664n\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.905657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:58.905656 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ea84f429-8934-4729-bb89-783d9ab2afde-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:59.391754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.391643 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" Nov 04 06:07:59.391754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.391674 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs" event={"ID":"ea84f429-8934-4729-bb89-783d9ab2afde","Type":"ContainerDied","Data":"3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b"} Nov 04 06:07:59.391754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.391739 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3483310b341ef4b72413ecb390e18aaea973c16ac91c6e689ef74b99a864af2b" Nov 04 06:07:59.393627 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.393602 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" event={"ID":"b16b914d-97b6-42b6-a84d-f903aaf2efb3","Type":"ContainerStarted","Data":"bda5cde276c6fddcb1f1882276d7cb99e993277bfe32c229f7a3cd314105dd5b"} Nov 04 06:07:59.393762 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.393645 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" event={"ID":"b16b914d-97b6-42b6-a84d-f903aaf2efb3","Type":"ContainerStarted","Data":"b1494223b999561b3b12bf04c6692a54637afb1cdac7384d3b4c92156f6bf10d"} Nov 04 06:07:59.523353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.523290 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" podStartSLOduration=2.5232705920000003 podStartE2EDuration="2.523270592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:59.517928561 +0000 UTC m=+1128.015323327" watchObservedRunningTime="2026-11-04 06:07:59.523270592 +0000 UTC m=+1128.020665356" Nov 04 06:07:59.559474 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.559445 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:07:59.615844 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.615815 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\") pod \"8a8315f1-33d2-40fe-bfda-859a13402885\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " Nov 04 06:07:59.616039 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.615880 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\") pod \"8a8315f1-33d2-40fe-bfda-859a13402885\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " Nov 04 06:07:59.616039 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.615925 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\" (UniqueName: \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\") pod \"8a8315f1-33d2-40fe-bfda-859a13402885\" (UID: \"8a8315f1-33d2-40fe-bfda-859a13402885\") " Nov 04 06:07:59.616169 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.616148 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca" pod "8a8315f1-33d2-40fe-bfda-859a13402885" (UID: "8a8315f1-33d2-40fe-bfda-859a13402885"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:07:59.616305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.616292 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:59.617987 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.617966 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q" pod "8a8315f1-33d2-40fe-bfda-859a13402885" (UID: "8a8315f1-33d2-40fe-bfda-859a13402885"). InnerVolumeSpecName "kube-api-access-ct97q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:59.618186 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.618169 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca" pod "8a8315f1-33d2-40fe-bfda-859a13402885" (UID: "8a8315f1-33d2-40fe-bfda-859a13402885"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:59.654382 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.654323 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:07:59.718533 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.718497 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8a8315f1-33d2-40fe-bfda-859a13402885-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:59.718533 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.718533 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct97q\" (UniqueName: \"kubernetes.io/projected/8a8315f1-33d2-40fe-bfda-859a13402885-kube-api-access-ct97q\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:59.771638 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:07:59.771609 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:08:00.209083 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.209042 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" podUID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" containerName="main" containerID="cri-o://1b171b9df1e3668609fe6c01344129c4707c24b4388bed4cff94b48cd6db7047" gracePeriod=45 Nov 04 06:08:00.406034 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.405996 4932 generic.go:356] "Generic (PLEG): container finished" podID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" containerID="1b171b9df1e3668609fe6c01344129c4707c24b4388bed4cff94b48cd6db7047" exitCode=0 Nov 04 06:08:00.406506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.406070 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" event={"ID":"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f","Type":"ContainerDied","Data":"1b171b9df1e3668609fe6c01344129c4707c24b4388bed4cff94b48cd6db7047"} Nov 04 06:08:00.408061 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.408032 4932 generic.go:356] "Generic (PLEG): container finished" podID="b16b914d-97b6-42b6-a84d-f903aaf2efb3" containerID="bda5cde276c6fddcb1f1882276d7cb99e993277bfe32c229f7a3cd314105dd5b" exitCode=0 Nov 04 06:08:00.408177 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.408115 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" event={"ID":"b16b914d-97b6-42b6-a84d-f903aaf2efb3","Type":"ContainerDied","Data":"bda5cde276c6fddcb1f1882276d7cb99e993277bfe32c229f7a3cd314105dd5b"} Nov 04 06:08:00.409587 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.409565 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" Nov 04 06:08:00.409664 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.409600 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc" event={"ID":"8a8315f1-33d2-40fe-bfda-859a13402885","Type":"ContainerDied","Data":"f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6"} Nov 04 06:08:00.409664 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.409637 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2f560beb7407cd06462571cd5b0497a84d06d91bd6f8d2830a9e5af3b22faf6" Nov 04 06:08:00.484458 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.484430 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:08:00.636045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636008 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636240 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636104 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636240 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636178 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\" (UniqueName: \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636240 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636230 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636411 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636274 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636411 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636324 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\") pod \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\" (UID: \"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f\") " Nov 04 06:08:00.636411 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636327 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.636573 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636405 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.636573 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636551 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.636777 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636746 4932 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tmp-dir\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.636777 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636770 4932 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-home\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.636914 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.636786 4932 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-model-cache\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.638801 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.638772 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "kube-api-access-5qhn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:00.638952 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.638931 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.639304 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.639278 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs" pod "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" (UID: "6c71c07f-bf79-4ae6-aa7b-cde912b35a6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:00.738331 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.738296 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qhn5\" (UniqueName: \"kubernetes.io/projected/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-kube-api-access-5qhn5\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.738331 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.738331 4932 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-tls-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.738598 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:00.738346 4932 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f-dshm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:01.420937 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.420904 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" Nov 04 06:08:01.421409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.420936 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg" event={"ID":"6c71c07f-bf79-4ae6-aa7b-cde912b35a6f","Type":"ContainerDied","Data":"907c44464793f8ac582f0a104408928b9ea6c9c1ac60d0e6d81981191916a908"} Nov 04 06:08:01.421409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.420989 4932 scope.go:122] "RemoveContainer" containerID="1b171b9df1e3668609fe6c01344129c4707c24b4388bed4cff94b48cd6db7047" Nov 04 06:08:01.674575 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.673972 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:08:01.688295 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.688260 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/premium-w5-6b62c0-kserve-69c94cb556-gwkbg"] Nov 04 06:08:01.712370 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.712341 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" podUID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" containerName="payload-processing" containerID="cri-o://0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52" gracePeriod=25 Nov 04 06:08:01.720493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.720472 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:08:01.834123 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.832004 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" podUID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" containerName="payload-pre-processing" containerID="cri-o://b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87" gracePeriod=25 Nov 04 06:08:01.881325 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.881292 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\" (UniqueName: \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\") pod \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " Nov 04 06:08:01.881464 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.881377 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\") pod \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " Nov 04 06:08:01.881464 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.881404 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\") pod \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\" (UID: \"b16b914d-97b6-42b6-a84d-f903aaf2efb3\") " Nov 04 06:08:01.881770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.881743 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca" pod "b16b914d-97b6-42b6-a84d-f903aaf2efb3" (UID: "b16b914d-97b6-42b6-a84d-f903aaf2efb3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:01.882502 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.882484 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:01.883481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.883462 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca" pod "b16b914d-97b6-42b6-a84d-f903aaf2efb3" (UID: "b16b914d-97b6-42b6-a84d-f903aaf2efb3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:01.883768 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.883739 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67" pod "b16b914d-97b6-42b6-a84d-f903aaf2efb3" (UID: "b16b914d-97b6-42b6-a84d-f903aaf2efb3"). InnerVolumeSpecName "kube-api-access-j9r67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:01.984027 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.983596 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9r67\" (UniqueName: \"kubernetes.io/projected/b16b914d-97b6-42b6-a84d-f903aaf2efb3-kube-api-access-j9r67\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:01.984027 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.983632 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b16b914d-97b6-42b6-a84d-f903aaf2efb3-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:01.994319 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:01.994288 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:08:02.084644 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.084610 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\" (UniqueName: \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\") pod \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " Nov 04 06:08:02.084870 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.084713 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\") pod \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\" (UID: \"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6\") " Nov 04 06:08:02.085144 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.085112 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume" pod "1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" (UID: "1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:02.085296 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.085280 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:02.086951 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.086920 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9" pod "1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" (UID: "1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6"). InnerVolumeSpecName "kube-api-access-k4nm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:02.105493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.105470 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:08:02.186072 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.186035 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4nm9\" (UniqueName: \"kubernetes.io/projected/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6-kube-api-access-k4nm9\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:02.287033 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.287003 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\" (UniqueName: \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\") pod \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " Nov 04 06:08:02.287222 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.287043 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\") pod \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\" (UID: \"42cec0a6-f1a2-47c3-921b-346209ba1eb6\") " Nov 04 06:08:02.287491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.287466 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume" pod "42cec0a6-f1a2-47c3-921b-346209ba1eb6" (UID: "42cec0a6-f1a2-47c3-921b-346209ba1eb6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:02.289101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.289080 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b" pod "42cec0a6-f1a2-47c3-921b-346209ba1eb6" (UID: "42cec0a6-f1a2-47c3-921b-346209ba1eb6"). InnerVolumeSpecName "kube-api-access-mqm9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:02.388437 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.388406 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqm9b\" (UniqueName: \"kubernetes.io/projected/42cec0a6-f1a2-47c3-921b-346209ba1eb6-kube-api-access-mqm9b\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:02.388437 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.388436 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42cec0a6-f1a2-47c3-921b-346209ba1eb6-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:02.430409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.430376 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" Nov 04 06:08:02.430409 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.430402 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8" event={"ID":"b16b914d-97b6-42b6-a84d-f903aaf2efb3","Type":"ContainerDied","Data":"b1494223b999561b3b12bf04c6692a54637afb1cdac7384d3b4c92156f6bf10d"} Nov 04 06:08:02.430943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.430482 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1494223b999561b3b12bf04c6692a54637afb1cdac7384d3b4c92156f6bf10d" Nov 04 06:08:02.431960 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.431932 4932 generic.go:356] "Generic (PLEG): container finished" podID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" containerID="b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87" exitCode=0 Nov 04 06:08:02.432070 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.431964 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" event={"ID":"42cec0a6-f1a2-47c3-921b-346209ba1eb6","Type":"ContainerDied","Data":"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87"} Nov 04 06:08:02.432070 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.431987 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" Nov 04 06:08:02.432070 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.432014 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw" event={"ID":"42cec0a6-f1a2-47c3-921b-346209ba1eb6","Type":"ContainerDied","Data":"d80edbecec0d3233672cd722662485532ef2d34254744dc45783597bfcfd5d4e"} Nov 04 06:08:02.432070 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.432044 4932 scope.go:122] "RemoveContainer" containerID="b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87" Nov 04 06:08:02.433850 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.433823 4932 generic.go:356] "Generic (PLEG): container finished" podID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" containerID="0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52" exitCode=0 Nov 04 06:08:02.433962 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.433856 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" event={"ID":"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6","Type":"ContainerDied","Data":"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52"} Nov 04 06:08:02.433962 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.433954 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" event={"ID":"1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6","Type":"ContainerDied","Data":"60bd8ed3f63ea8f91eed0223dad77426a91646dcbe624b8a1e30716148a3da61"} Nov 04 06:08:02.434087 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.434031 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct" Nov 04 06:08:02.445424 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.445406 4932 scope.go:122] "RemoveContainer" containerID="b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87" Nov 04 06:08:02.445689 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:02.445662 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87\": container with ID starting with b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87 not found: ID does not exist" containerID="b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87" Nov 04 06:08:02.445804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.445699 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87"} err="failed to get container status \"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87\": rpc error: code = NotFound desc = could not find container \"b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87\": container with ID starting with b94a0a5bf4ce95762b9d3d89b2d820eff41d74418ceef1ba17a86ec1d9153b87 not found: ID does not exist" Nov 04 06:08:02.445804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.445720 4932 scope.go:122] "RemoveContainer" containerID="0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52" Nov 04 06:08:02.454600 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.454580 4932 scope.go:122] "RemoveContainer" containerID="0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52" Nov 04 06:08:02.454903 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:02.454885 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52\": container with ID starting with 0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52 not found: ID does not exist" containerID="0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52" Nov 04 06:08:02.454975 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.454907 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52"} err="failed to get container status \"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52\": rpc error: code = NotFound desc = could not find container \"0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52\": container with ID starting with 0dada79a31d86493d95c13cc29b33861670b1808b4e01ce9b2e65914c5c65f52 not found: ID does not exist" Nov 04 06:08:02.550737 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.550628 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:08:02.617889 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.617775 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:08:02.623999 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.623973 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw"] Nov 04 06:08:02.798627 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.798591 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:08:02.802388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:02.802314 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct"] Nov 04 06:08:03.621046 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:03.621004 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" path="/var/lib/kubelet/pods/1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6/volumes" Nov 04 06:08:03.621583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:03.621564 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" path="/var/lib/kubelet/pods/42cec0a6-f1a2-47c3-921b-346209ba1eb6/volumes" Nov 04 06:08:03.622133 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:03.622115 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" path="/var/lib/kubelet/pods/6c71c07f-bf79-4ae6-aa7b-cde912b35a6f/volumes" Nov 04 06:08:04.655493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:04.655450 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" podUID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" containerName="payload-processing" containerID="cri-o://50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae" gracePeriod=25 Nov 04 06:08:04.772274 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:04.772236 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" containerID="cri-o://61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8" gracePeriod=25 Nov 04 06:08:05.001299 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.001273 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:08:05.157187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.157149 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\" (UniqueName: \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\") pod \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " Nov 04 06:08:05.162908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.157505 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\") pod \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\" (UID: \"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5\") " Nov 04 06:08:05.180747 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.170071 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume" pod "c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" (UID: "c6253218-1d97-4cbb-89a3-e2fbfad5bbb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:05.180747 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.179899 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w" pod "c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" (UID: "c6253218-1d97-4cbb-89a3-e2fbfad5bbb5"). InnerVolumeSpecName "kube-api-access-fvk5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:05.190751 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.190174 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:08:05.265057 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.264978 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvk5w\" (UniqueName: \"kubernetes.io/projected/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-kube-api-access-fvk5w\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:05.265057 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.265006 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:05.283089 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.283055 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:08:05.467664 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.467627 4932 generic.go:356] "Generic (PLEG): container finished" podID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" containerID="50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae" exitCode=0 Nov 04 06:08:05.467850 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.467691 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" Nov 04 06:08:05.467912 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.467867 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" event={"ID":"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5","Type":"ContainerDied","Data":"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae"} Nov 04 06:08:05.467964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.467952 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg" event={"ID":"c6253218-1d97-4cbb-89a3-e2fbfad5bbb5","Type":"ContainerDied","Data":"a7b9ca01eb837ef7ec2de0bcc396fc590b7741d54669fc3d1c9ec145d1517255"} Nov 04 06:08:05.468010 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.467989 4932 scope.go:122] "RemoveContainer" containerID="50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae" Nov 04 06:08:05.485756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.485719 4932 scope.go:122] "RemoveContainer" containerID="50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae" Nov 04 06:08:05.486042 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:05.486020 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae\": container with ID starting with 50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae not found: ID does not exist" containerID="50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae" Nov 04 06:08:05.486128 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.486055 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae"} err="failed to get container status \"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae\": rpc error: code = NotFound desc = could not find container \"50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae\": container with ID starting with 50ed36b2ec16f8e995c2ffbbbae56b5fd979c3a90d4f9bd2110b184bd5918fae not found: ID does not exist" Nov 04 06:08:05.672755 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.668785 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:08:05.801755 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:05.801552 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg"] Nov 04 06:08:07.551797 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:07.551742 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" containerID="cri-o://de1ccd548fdf6b55e6777e418b8d705fae7aee529fdab6296ef57cf374ecd940" gracePeriod=25 Nov 04 06:08:07.619268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:07.619238 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" path="/var/lib/kubelet/pods/c6253218-1d97-4cbb-89a3-e2fbfad5bbb5/volumes" Nov 04 06:08:08.373334 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:08.373296 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:10.191550 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:10.191484 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" containerID="cri-o://e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712" gracePeriod=25 Nov 04 06:08:10.284231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:10.284172 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" containerID="cri-o://a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c" gracePeriod=25 Nov 04 06:08:10.310585 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:10.310545 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:13.331614 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:13.331573 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:13.332038 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:13.331635 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:17.069248 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069218 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:17.069760 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069745 4932 cpu_manager.go:414] "containerMap: removing container" podUID="b16b914d-97b6-42b6-a84d-f903aaf2efb3" containerName="revoke-keys" Nov 04 06:08:17.069760 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069760 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b16b914d-97b6-42b6-a84d-f903aaf2efb3" containerName="revoke-keys" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069771 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8a8315f1-33d2-40fe-bfda-859a13402885" containerName="revoke-keys" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069777 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a8315f1-33d2-40fe-bfda-859a13402885" containerName="revoke-keys" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069792 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ea84f429-8934-4729-bb89-783d9ab2afde" containerName="revoke-keys" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069797 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea84f429-8934-4729-bb89-783d9ab2afde" containerName="revoke-keys" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069807 4932 cpu_manager.go:414] "containerMap: removing container" podUID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" containerName="main" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069811 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" containerName="main" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069833 4932 cpu_manager.go:414] "containerMap: removing container" podUID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" containerName="payload-processing" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069837 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" containerName="payload-processing" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069847 4932 cpu_manager.go:414] "containerMap: removing container" podUID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" containerName="payload-pre-processing" Nov 04 06:08:17.069851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069854 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" containerName="payload-pre-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069862 4932 cpu_manager.go:414] "containerMap: removing container" podUID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" containerName="payload-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069866 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" containerName="payload-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069941 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="42cec0a6-f1a2-47c3-921b-346209ba1eb6" containerName="payload-pre-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069950 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6253218-1d97-4cbb-89a3-e2fbfad5bbb5" containerName="payload-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069958 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="b16b914d-97b6-42b6-a84d-f903aaf2efb3" containerName="revoke-keys" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069965 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a8315f1-33d2-40fe-bfda-859a13402885" containerName="revoke-keys" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069973 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b2032a4-a785-4f0c-9ce6-915d8e1ec2e6" containerName="payload-processing" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069979 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea84f429-8934-4729-bb89-783d9ab2afde" containerName="revoke-keys" Nov 04 06:08:17.070143 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.069986 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c71c07f-bf79-4ae6-aa7b-cde912b35a6f" containerName="main" Nov 04 06:08:17.075154 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.075134 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.131498 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.131461 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrst5\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.131789 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.131716 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.132049 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.132031 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.132387 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.132368 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.132575 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.132542 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.132713 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.132698 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.132886 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.132871 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.133364 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.133166 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.133364 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.133247 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.186647 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.186617 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-356418-openshift-default-dockercfg-btfls\"" Nov 04 06:08:17.189454 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.189426 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:17.234572 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234546 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234592 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234655 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrst5\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234685 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234860 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234784 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234921 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234858 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.234921 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234885 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235024 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234919 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235024 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.234950 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235356 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.235303 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235454 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.235366 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235621 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.235590 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.235623 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.235877 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.235856 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.237051 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.237027 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.237509 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.237479 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.323306 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.320126 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.330659 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.324142 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrst5\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.374528 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:17.374493 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:08:17.388885 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.388857 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:17.837358 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:08:17.837328 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359cf448_3118_4332_931d_7a7864f8a952.slice/crio-150f414207b3c5b5ad4945c64ddb5eee280cd0059cbfb79b7e83c7e1a6de5697 WatchSource:0}: Error finding container 150f414207b3c5b5ad4945c64ddb5eee280cd0059cbfb79b7e83c7e1a6de5697: Status 404 returned error can't find the container with id 150f414207b3c5b5ad4945c64ddb5eee280cd0059cbfb79b7e83c7e1a6de5697 Nov 04 06:08:17.838953 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.838830 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:17.839970 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.839931 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:08:17.840052 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.840019 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:08:17.840090 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:17.840062 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:08:18.372837 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:18.372799 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:18.631394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:18.631300 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" event={"ID":"359cf448-3118-4332-931d-7a7864f8a952","Type":"ContainerStarted","Data":"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54"} Nov 04 06:08:18.631394 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:18.631374 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" event={"ID":"359cf448-3118-4332-931d-7a7864f8a952","Type":"ContainerStarted","Data":"150f414207b3c5b5ad4945c64ddb5eee280cd0059cbfb79b7e83c7e1a6de5697"} Nov 04 06:08:19.398149 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:19.398112 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:19.404198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:19.404168 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:19.404423 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:19.404396 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:20.319528 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:20.319487 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:20.390314 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:20.390278 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:20.390474 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:20.390336 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:21.390008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:21.389975 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:21.390428 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:21.390034 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:22.389934 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:22.389899 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:22.390100 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:22.389961 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:23.033381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.033317 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podStartSLOduration=6.03329848 podStartE2EDuration="6.03329848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:18.770151684 +0000 UTC m=+1147.267546538" watchObservedRunningTime="2026-11-04 06:08:23.03329848 +0000 UTC m=+1151.530693246" Nov 04 06:08:23.039558 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.039525 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:08:23.039992 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.039965 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" containerID="cri-o://896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df" gracePeriod=30 Nov 04 06:08:23.331125 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.331024 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:23.331282 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.331111 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:08:23.389679 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.389639 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:23.389862 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.389693 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:23.821454 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.821416 4932 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:08:23.821886 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:23.821479 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:08:24.390106 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:24.390060 4932 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 06:08:24.390312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:24.390132 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 06:08:25.070445 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.070413 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:08:25.136920 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.136880 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\") pod \"e871cddd-d411-41ee-a7b0-af6af0e101d9\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " Nov 04 06:08:25.137088 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.136934 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\" (UniqueName: \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\") pod \"e871cddd-d411-41ee-a7b0-af6af0e101d9\" (UID: \"e871cddd-d411-41ee-a7b0-af6af0e101d9\") " Nov 04 06:08:25.137375 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.137351 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume" pod "e871cddd-d411-41ee-a7b0-af6af0e101d9" (UID: "e871cddd-d411-41ee-a7b0-af6af0e101d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:25.137478 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.137457 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e871cddd-d411-41ee-a7b0-af6af0e101d9-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:25.139111 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.139079 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv" pod "e871cddd-d411-41ee-a7b0-af6af0e101d9" (UID: "e871cddd-d411-41ee-a7b0-af6af0e101d9"). InnerVolumeSpecName "kube-api-access-225zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:25.238527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.238493 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-225zv\" (UniqueName: \"kubernetes.io/projected/e871cddd-d411-41ee-a7b0-af6af0e101d9-kube-api-access-225zv\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:25.689851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.689814 4932 generic.go:356] "Generic (PLEG): container finished" podID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerID="61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8" exitCode=0 Nov 04 06:08:25.690048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.689864 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" Nov 04 06:08:25.690048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.689899 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" event={"ID":"e871cddd-d411-41ee-a7b0-af6af0e101d9","Type":"ContainerDied","Data":"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8"} Nov 04 06:08:25.690048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.689956 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq" event={"ID":"e871cddd-d411-41ee-a7b0-af6af0e101d9","Type":"ContainerDied","Data":"3aec1539f03013f14bd8e493d6f6ee63e3e4bf4f2a50f7473eba49d026dcda56"} Nov 04 06:08:25.690048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.689987 4932 scope.go:122] "RemoveContainer" containerID="61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8" Nov 04 06:08:25.702205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.702185 4932 scope.go:122] "RemoveContainer" containerID="61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8" Nov 04 06:08:25.702549 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:25.702529 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8\": container with ID starting with 61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8 not found: ID does not exist" containerID="61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8" Nov 04 06:08:25.702648 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.702559 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8"} err="failed to get container status \"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8\": rpc error: code = NotFound desc = could not find container \"61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8\": container with ID starting with 61b7f37ed0adcfbd94a78fcf39b29c859f9f7be6c1c1097d04b8ab833edeaaa8 not found: ID does not exist" Nov 04 06:08:25.860021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.859986 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:25.860460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.860434 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:25.861673 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.861653 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:25.869814 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.869788 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:08:25.873775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:25.873752 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq"] Nov 04 06:08:26.168689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:26.168651 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:08:26.169194 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:26.168910 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" containerID="cri-o://876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f" gracePeriod=30 Nov 04 06:08:27.618371 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.618341 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" path="/var/lib/kubelet/pods/e871cddd-d411-41ee-a7b0-af6af0e101d9/volumes" Nov 04 06:08:27.708310 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.708268 4932 generic.go:356] "Generic (PLEG): container finished" podID="de8d6929-5056-47c8-8424-35989c743d96" containerID="de1ccd548fdf6b55e6777e418b8d705fae7aee529fdab6296ef57cf374ecd940" exitCode=0 Nov 04 06:08:27.708571 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.708526 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" event={"ID":"de8d6929-5056-47c8-8424-35989c743d96","Type":"ContainerDied","Data":"de1ccd548fdf6b55e6777e418b8d705fae7aee529fdab6296ef57cf374ecd940"} Nov 04 06:08:27.847150 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.847120 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:08:27.913452 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.913415 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\" (UniqueName: \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\") pod \"de8d6929-5056-47c8-8424-35989c743d96\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " Nov 04 06:08:27.913660 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.913471 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\") pod \"de8d6929-5056-47c8-8424-35989c743d96\" (UID: \"de8d6929-5056-47c8-8424-35989c743d96\") " Nov 04 06:08:27.913866 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.913841 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume" pod "de8d6929-5056-47c8-8424-35989c743d96" (UID: "de8d6929-5056-47c8-8424-35989c743d96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:27.913993 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.913965 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8d6929-5056-47c8-8424-35989c743d96-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:27.915509 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:27.915487 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn" pod "de8d6929-5056-47c8-8424-35989c743d96" (UID: "de8d6929-5056-47c8-8424-35989c743d96"). InnerVolumeSpecName "kube-api-access-26lfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:28.015134 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.015088 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26lfn\" (UniqueName: \"kubernetes.io/projected/de8d6929-5056-47c8-8424-35989c743d96-kube-api-access-26lfn\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.188067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.188028 4932 patch_prober.go:29] interesting pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:08:28.188213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.188099 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:08:28.301015 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.300986 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:08:28.419652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419566 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.419652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419643 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.419935 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419721 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.419935 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419801 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.419935 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419892 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.420101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419947 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.420101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419948 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:28.420101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.419973 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.420101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420034 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.420101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420078 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\") pod \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\" (UID: \"e4e25ae2-db0a-4745-bc85-cdf4819b380f\") " Nov 04 06:08:28.420354 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420195 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:28.420539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420503 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.420539 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420531 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.420756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420532 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:28.420756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420701 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:28.420923 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.420898 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:28.422637 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.422608 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:28.422964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.422937 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:28.423369 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.423345 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:28.423502 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.423415 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2" pod "e4e25ae2-db0a-4745-bc85-cdf4819b380f" (UID: "e4e25ae2-db0a-4745-bc85-cdf4819b380f"). InnerVolumeSpecName "kube-api-access-9lsb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:28.522015 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.521984 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522017 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522040 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e25ae2-db0a-4745-bc85-cdf4819b380f-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522052 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522066 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lsb2\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-kube-api-access-9lsb2\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522079 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.522180 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.522087 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e25ae2-db0a-4745-bc85-cdf4819b380f-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:28.718548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.718511 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" event={"ID":"de8d6929-5056-47c8-8424-35989c743d96","Type":"ContainerDied","Data":"4b3fbe4b42ee4dd51cf7084ebfd18b8d63478585b17488cc60ee5b487dd8a839"} Nov 04 06:08:28.718999 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.718574 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv" Nov 04 06:08:28.718999 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.718582 4932 scope.go:122] "RemoveContainer" containerID="de1ccd548fdf6b55e6777e418b8d705fae7aee529fdab6296ef57cf374ecd940" Nov 04 06:08:28.720157 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.720128 4932 generic.go:356] "Generic (PLEG): container finished" podID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerID="896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df" exitCode=0 Nov 04 06:08:28.720299 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.720181 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" Nov 04 06:08:28.720299 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.720211 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" event={"ID":"e4e25ae2-db0a-4745-bc85-cdf4819b380f","Type":"ContainerDied","Data":"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df"} Nov 04 06:08:28.720299 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.720268 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk" event={"ID":"e4e25ae2-db0a-4745-bc85-cdf4819b380f","Type":"ContainerDied","Data":"e621662d87466155ad6c549cf617da58b75d7771d18f55f66711b053d47fff67"} Nov 04 06:08:28.730683 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.730664 4932 scope.go:122] "RemoveContainer" containerID="896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df" Nov 04 06:08:28.740024 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.740003 4932 scope.go:122] "RemoveContainer" containerID="896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df" Nov 04 06:08:28.740319 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:28.740303 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df\": container with ID starting with 896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df not found: ID does not exist" containerID="896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df" Nov 04 06:08:28.740359 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.740327 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df"} err="failed to get container status \"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df\": rpc error: code = NotFound desc = could not find container \"896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df\": container with ID starting with 896d30a4721878a3f6914456f907c4c55888274dbd6e93a7497af553afe7a0df not found: ID does not exist" Nov 04 06:08:28.896670 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.896634 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:08:28.900215 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:28.900186 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk"] Nov 04 06:08:29.016007 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.015874 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:08:29.021158 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.021126 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv"] Nov 04 06:08:29.620396 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.620366 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de8d6929-5056-47c8-8424-35989c743d96" path="/var/lib/kubelet/pods/de8d6929-5056-47c8-8424-35989c743d96/volumes" Nov 04 06:08:29.620943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.620921 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" path="/var/lib/kubelet/pods/e4e25ae2-db0a-4745-bc85-cdf4819b380f/volumes" Nov 04 06:08:29.908964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.908881 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:29.909459 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:29.909113 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" containerID="cri-o://28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54" gracePeriod=30 Nov 04 06:08:30.564425 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.564396 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:08:30.585069 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.585044 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:08:30.677616 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.677585 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\") pod \"a9143134-590e-4a8d-a6d1-c7045e669969\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " Nov 04 06:08:30.677838 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.677819 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\" (UniqueName: \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\") pod \"a9143134-590e-4a8d-a6d1-c7045e669969\" (UID: \"a9143134-590e-4a8d-a6d1-c7045e669969\") " Nov 04 06:08:30.677955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.677934 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume" pod "a9143134-590e-4a8d-a6d1-c7045e669969" (UID: "a9143134-590e-4a8d-a6d1-c7045e669969"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:30.678230 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.678210 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9143134-590e-4a8d-a6d1-c7045e669969-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:30.679909 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.679892 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8" pod "a9143134-590e-4a8d-a6d1-c7045e669969" (UID: "a9143134-590e-4a8d-a6d1-c7045e669969"). InnerVolumeSpecName "kube-api-access-4rzt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:30.739000 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.738971 4932 generic.go:356] "Generic (PLEG): container finished" podID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerID="a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c" exitCode=0 Nov 04 06:08:30.739165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.739021 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" Nov 04 06:08:30.739165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.739058 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" event={"ID":"0f0752c5-37a4-4ad8-801b-1d5a14b690b1","Type":"ContainerDied","Data":"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c"} Nov 04 06:08:30.739165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.739123 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t" event={"ID":"0f0752c5-37a4-4ad8-801b-1d5a14b690b1","Type":"ContainerDied","Data":"c00651de4417af5e4901dbea2f21dfd7f581751e9efd9411700b26ca57becae3"} Nov 04 06:08:30.739165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.739156 4932 scope.go:122] "RemoveContainer" containerID="a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c" Nov 04 06:08:30.740594 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.740572 4932 generic.go:356] "Generic (PLEG): container finished" podID="a9143134-590e-4a8d-a6d1-c7045e669969" containerID="e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712" exitCode=0 Nov 04 06:08:30.740669 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.740612 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" Nov 04 06:08:30.740669 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.740651 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" event={"ID":"a9143134-590e-4a8d-a6d1-c7045e669969","Type":"ContainerDied","Data":"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712"} Nov 04 06:08:30.740818 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.740696 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2" event={"ID":"a9143134-590e-4a8d-a6d1-c7045e669969","Type":"ContainerDied","Data":"25577f47ad919608b76185c7b49824fd9e8ae7c1ab850c28ef3839eeb04e714c"} Nov 04 06:08:30.749176 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.749156 4932 scope.go:122] "RemoveContainer" containerID="a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c" Nov 04 06:08:30.749426 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:30.749406 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c\": container with ID starting with a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c not found: ID does not exist" containerID="a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c" Nov 04 06:08:30.749474 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.749438 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c"} err="failed to get container status \"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c\": rpc error: code = NotFound desc = could not find container \"a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c\": container with ID starting with a27761fdfbf320056324f0a1b12b75fa873e6ff6ba69b164e90dbccd4305822c not found: ID does not exist" Nov 04 06:08:30.749474 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.749461 4932 scope.go:122] "RemoveContainer" containerID="e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712" Nov 04 06:08:30.758220 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.758207 4932 scope.go:122] "RemoveContainer" containerID="e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712" Nov 04 06:08:30.758482 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:30.758466 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712\": container with ID starting with e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712 not found: ID does not exist" containerID="e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712" Nov 04 06:08:30.758529 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.758488 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712"} err="failed to get container status \"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712\": rpc error: code = NotFound desc = could not find container \"e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712\": container with ID starting with e2f84aab582209668af8f0fb9b049be81b6c88babee875e61386274f67493712 not found: ID does not exist" Nov 04 06:08:30.778995 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.778974 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\" (UniqueName: \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\") pod \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " Nov 04 06:08:30.779093 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.779053 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\") pod \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\" (UID: \"0f0752c5-37a4-4ad8-801b-1d5a14b690b1\") " Nov 04 06:08:30.779411 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.779377 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume" pod "0f0752c5-37a4-4ad8-801b-1d5a14b690b1" (UID: "0f0752c5-37a4-4ad8-801b-1d5a14b690b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:30.779517 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.779497 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:30.779517 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.779517 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rzt8\" (UniqueName: \"kubernetes.io/projected/a9143134-590e-4a8d-a6d1-c7045e669969-kube-api-access-4rzt8\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:30.781140 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.781121 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd" pod "0f0752c5-37a4-4ad8-801b-1d5a14b690b1" (UID: "0f0752c5-37a4-4ad8-801b-1d5a14b690b1"). InnerVolumeSpecName "kube-api-access-gmbbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:30.880574 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.880544 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmbbd\" (UniqueName: \"kubernetes.io/projected/0f0752c5-37a4-4ad8-801b-1d5a14b690b1-kube-api-access-gmbbd\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:30.994804 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.990676 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:08:30.999993 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:30.999965 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2"] Nov 04 06:08:31.168435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.168400 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:08:31.171582 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.171563 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t"] Nov 04 06:08:31.428742 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.428698 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:08:31.588105 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588024 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588105 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588069 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588129 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588159 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588216 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588233 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588309 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.588614 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588511 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:31.588675 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588650 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:31.588936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588914 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:31.589035 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588944 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.589035 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588948 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:31.589035 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589000 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\") pod \"68e39787-663f-4340-b4ae-62350a29f75b\" (UID: \"68e39787-663f-4340-b4ae-62350a29f75b\") " Nov 04 06:08:31.589195 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.588980 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:31.589491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589459 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.589601 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589494 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.589601 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589508 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.589601 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589520 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.589601 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.589550 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e39787-663f-4340-b4ae-62350a29f75b-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.590894 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.590861 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "kube-api-access-jd9v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:31.591044 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.591018 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:31.591253 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.591225 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:31.591617 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.591597 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy" pod "68e39787-663f-4340-b4ae-62350a29f75b" (UID: "68e39787-663f-4340-b4ae-62350a29f75b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:31.619475 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.619448 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" path="/var/lib/kubelet/pods/0f0752c5-37a4-4ad8-801b-1d5a14b690b1/volumes" Nov 04 06:08:31.619876 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.619862 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" path="/var/lib/kubelet/pods/a9143134-590e-4a8d-a6d1-c7045e669969/volumes" Nov 04 06:08:31.691050 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.691018 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.691050 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.691045 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e39787-663f-4340-b4ae-62350a29f75b-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.691050 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.691054 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e39787-663f-4340-b4ae-62350a29f75b-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.691268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.691065 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd9v9\" (UniqueName: \"kubernetes.io/projected/68e39787-663f-4340-b4ae-62350a29f75b-kube-api-access-jd9v9\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:31.751641 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.751603 4932 generic.go:356] "Generic (PLEG): container finished" podID="68e39787-663f-4340-b4ae-62350a29f75b" containerID="876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f" exitCode=0 Nov 04 06:08:31.751828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.751664 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" Nov 04 06:08:31.751828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.751676 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerDied","Data":"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f"} Nov 04 06:08:31.751828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.751749 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6" event={"ID":"68e39787-663f-4340-b4ae-62350a29f75b","Type":"ContainerDied","Data":"1fc2bbb8bd7aec1e7d6d432397b06be04c21be42c72a35d2dc2fd432f8cd6524"} Nov 04 06:08:31.751828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.751774 4932 scope.go:122] "RemoveContainer" containerID="876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f" Nov 04 06:08:31.762888 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.762870 4932 scope.go:122] "RemoveContainer" containerID="b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2" Nov 04 06:08:31.772332 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.772316 4932 scope.go:122] "RemoveContainer" containerID="876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f" Nov 04 06:08:31.772557 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:31.772538 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f\": container with ID starting with 876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f not found: ID does not exist" containerID="876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f" Nov 04 06:08:31.772635 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.772571 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f"} err="failed to get container status \"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f\": rpc error: code = NotFound desc = could not find container \"876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f\": container with ID starting with 876321a3d811fab3ee18832b35f56cf05b001d4b31668373ef0bf544f8ec4c4f not found: ID does not exist" Nov 04 06:08:31.772635 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.772599 4932 scope.go:122] "RemoveContainer" containerID="b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2" Nov 04 06:08:31.772847 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:31.772830 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2\": container with ID starting with b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2 not found: ID does not exist" containerID="b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2" Nov 04 06:08:31.772887 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.772853 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2"} err="failed to get container status \"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2\": rpc error: code = NotFound desc = could not find container \"b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2\": container with ID starting with b167525cf1d91075544d4e89187ade8c3820427dd5a5c8d032eaa9571c00e0c2 not found: ID does not exist" Nov 04 06:08:31.929824 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.929663 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:08:31.934128 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:31.934104 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6"] Nov 04 06:08:33.618842 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:33.618814 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68e39787-663f-4340-b4ae-62350a29f75b" path="/var/lib/kubelet/pods/68e39787-663f-4340-b4ae-62350a29f75b/volumes" Nov 04 06:08:35.180271 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.180211 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:35.226031 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.225997 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226060 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226172 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226193 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226228 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226247 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226279 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226515 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226416 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226515 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226447 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\") pod \"359cf448-3118-4332-931d-7a7864f8a952\" (UID: \"359cf448-3118-4332-931d-7a7864f8a952\") " Nov 04 06:08:35.226515 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226445 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:35.226515 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226454 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:35.226746 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226626 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:35.226746 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226638 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:35.226859 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226844 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:35.226997 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226977 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/359cf448-3118-4332-931d-7a7864f8a952-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.226997 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.226996 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.227168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.227006 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.227168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.227014 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.227168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.227023 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.229072 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.229039 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:35.229206 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.229177 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:35.229294 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.229053 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:35.229294 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.229234 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5" pod "359cf448-3118-4332-931d-7a7864f8a952" (UID: "359cf448-3118-4332-931d-7a7864f8a952"). InnerVolumeSpecName "kube-api-access-xrst5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:35.327756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.327705 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/359cf448-3118-4332-931d-7a7864f8a952-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.327756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.327752 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/359cf448-3118-4332-931d-7a7864f8a952-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.327964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.327768 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.327964 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.327784 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrst5\" (UniqueName: \"kubernetes.io/projected/359cf448-3118-4332-931d-7a7864f8a952-kube-api-access-xrst5\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:35.788052 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.788018 4932 generic.go:356] "Generic (PLEG): container finished" podID="359cf448-3118-4332-931d-7a7864f8a952" containerID="28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54" exitCode=0 Nov 04 06:08:35.788247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.788095 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" Nov 04 06:08:35.788247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.788103 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" event={"ID":"359cf448-3118-4332-931d-7a7864f8a952","Type":"ContainerDied","Data":"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54"} Nov 04 06:08:35.788247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.788169 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr" event={"ID":"359cf448-3118-4332-931d-7a7864f8a952","Type":"ContainerDied","Data":"150f414207b3c5b5ad4945c64ddb5eee280cd0059cbfb79b7e83c7e1a6de5697"} Nov 04 06:08:35.788247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.788200 4932 scope.go:122] "RemoveContainer" containerID="28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54" Nov 04 06:08:35.806514 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.804738 4932 scope.go:122] "RemoveContainer" containerID="28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54" Nov 04 06:08:35.806514 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:35.805068 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54\": container with ID starting with 28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54 not found: ID does not exist" containerID="28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54" Nov 04 06:08:35.806514 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.805098 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54"} err="failed to get container status \"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54\": rpc error: code = NotFound desc = could not find container \"28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54\": container with ID starting with 28f520390ac88bea8855dc5ba5aab3d862c249d105f0b4531d089233cfa93e54 not found: ID does not exist" Nov 04 06:08:35.969047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:35.969020 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:36.022552 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:36.022524 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr"] Nov 04 06:08:37.619473 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:37.619439 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="359cf448-3118-4332-931d-7a7864f8a952" path="/var/lib/kubelet/pods/359cf448-3118-4332-931d-7a7864f8a952/volumes" Nov 04 06:08:37.927053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:37.926956 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:08:37.927231 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:37.927181 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" containerID="cri-o://44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb" gracePeriod=30 Nov 04 06:08:39.980117 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:39.980081 4932 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:08:39.980650 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:39.980147 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:08:43.196435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.196380 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:08:43.329748 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329693 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.329911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329761 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.329911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329799 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.329911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329819 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.329911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329842 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.330110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.329948 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.330110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330002 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:43.330110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330007 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.330110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330082 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:43.330327 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330136 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.330327 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330163 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:43.330327 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330213 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\") pod \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\" (UID: \"11a25c1d-8e92-40b6-8094-8b54f9ef37ba\") " Nov 04 06:08:43.330327 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330258 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:43.330506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330353 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:43.330617 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330579 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.330617 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330613 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.330789 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330627 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.330789 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330640 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.330789 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.330653 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.332197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.332170 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:43.332304 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.332248 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:43.332304 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.332271 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:43.332417 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.332373 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h" pod "11a25c1d-8e92-40b6-8094-8b54f9ef37ba" (UID: "11a25c1d-8e92-40b6-8094-8b54f9ef37ba"). InnerVolumeSpecName "kube-api-access-67h6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:43.432021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.431990 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.432021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.432016 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.432021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.432027 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67h6h\" (UniqueName: \"kubernetes.io/projected/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-kube-api-access-67h6h\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.432253 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.432036 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11a25c1d-8e92-40b6-8094-8b54f9ef37ba-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:43.852750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.852687 4932 generic.go:356] "Generic (PLEG): container finished" podID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerID="44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb" exitCode=0 Nov 04 06:08:43.852930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.852754 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" Nov 04 06:08:43.852930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.852772 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerDied","Data":"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb"} Nov 04 06:08:43.852930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.852834 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt" event={"ID":"11a25c1d-8e92-40b6-8094-8b54f9ef37ba","Type":"ContainerDied","Data":"1ce20bb0725a386a70bb072558d8d77d28cfcc3d46e98bb109af4fa2f31824d5"} Nov 04 06:08:43.852930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.852853 4932 scope.go:122] "RemoveContainer" containerID="44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb" Nov 04 06:08:43.862536 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.862520 4932 scope.go:122] "RemoveContainer" containerID="9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6" Nov 04 06:08:43.871124 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.871106 4932 scope.go:122] "RemoveContainer" containerID="44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb" Nov 04 06:08:43.871422 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:43.871393 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb\": container with ID starting with 44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb not found: ID does not exist" containerID="44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb" Nov 04 06:08:43.871489 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.871433 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb"} err="failed to get container status \"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb\": rpc error: code = NotFound desc = could not find container \"44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb\": container with ID starting with 44df8c0764cafbabe5408aff618111d9157dec17406b3b776a9346a01bd3fcbb not found: ID does not exist" Nov 04 06:08:43.871489 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.871452 4932 scope.go:122] "RemoveContainer" containerID="9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6" Nov 04 06:08:43.871707 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:43.871692 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6\": container with ID starting with 9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6 not found: ID does not exist" containerID="9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6" Nov 04 06:08:43.871776 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:43.871711 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6"} err="failed to get container status \"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6\": rpc error: code = NotFound desc = could not find container \"9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6\": container with ID starting with 9a8bceb7e39974f0db0ced5cd83659ab3298deccac9910b245a0c9c6695b20b6 not found: ID does not exist" Nov 04 06:08:44.030208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:44.030181 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:08:44.083782 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:44.083758 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt"] Nov 04 06:08:45.618823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:45.618791 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" path="/var/lib/kubelet/pods/11a25c1d-8e92-40b6-8094-8b54f9ef37ba/volumes" Nov 04 06:08:47.370036 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:08:47.370002 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:08:48.063517 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.063484 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-cxtqr-269jx"] Nov 04 06:08:48.064009 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.063993 4932 cpu_manager.go:414] "containerMap: removing container" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064011 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064027 4932 cpu_manager.go:414] "containerMap: removing container" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064031 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064040 4932 cpu_manager.go:414] "containerMap: removing container" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064044 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064052 4932 cpu_manager.go:414] "containerMap: removing container" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" Nov 04 06:08:48.064062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064058 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064074 4932 cpu_manager.go:414] "containerMap: removing container" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064079 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064096 4932 cpu_manager.go:414] "containerMap: removing container" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064102 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064114 4932 cpu_manager.go:414] "containerMap: removing container" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064118 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064126 4932 cpu_manager.go:414] "containerMap: removing container" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064130 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064141 4932 cpu_manager.go:414] "containerMap: removing container" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064145 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064210 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064217 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064225 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="e871cddd-d411-41ee-a7b0-af6af0e101d9" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064232 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="359cf448-3118-4332-931d-7a7864f8a952" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064239 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064245 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9143134-590e-4a8d-a6d1-c7045e669969" containerName="payload-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064251 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f0752c5-37a4-4ad8-801b-1d5a14b690b1" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064255 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="de8d6929-5056-47c8-8424-35989c743d96" containerName="payload-pre-processing" Nov 04 06:08:48.064286 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.064261 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4e25ae2-db0a-4745-bc85-cdf4819b380f" containerName="istio-proxy" Nov 04 06:08:48.068971 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.068953 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.126672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.126646 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-cxtqr-269jx"] Nov 04 06:08:48.176744 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.176694 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dhhmg\"" Nov 04 06:08:48.188331 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.188302 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.188454 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.188375 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.188519 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.188458 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.188574 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.188552 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bngbn\" (UniqueName: \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289184 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289147 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289368 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289210 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289368 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289238 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289368 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289282 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bngbn\" (UniqueName: \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289709 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289683 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.289871 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.289854 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.290074 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.290045 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.354168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.354101 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bngbn\" (UniqueName: \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\") pod \"periodic-gathering-cxtqr-269jx\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.382102 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.382071 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:08:48.770721 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.770687 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-cxtqr-269jx"] Nov 04 06:08:48.771756 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:08:48.771704 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50034b21_7861_46ed_81eb_c71bdf4ffeea.slice/crio-701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c WatchSource:0}: Error finding container 701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c: Status 404 returned error can't find the container with id 701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c Nov 04 06:08:48.889806 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.889697 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-cxtqr-269jx" event={"ID":"50034b21-7861-46ed-81eb-c71bdf4ffeea","Type":"ContainerStarted","Data":"4388542057ac86394d435a9416af63bfdd5d54601d4ae23de4d90f222d098ce1"} Nov 04 06:08:48.889806 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:48.889760 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-cxtqr-269jx" event={"ID":"50034b21-7861-46ed-81eb-c71bdf4ffeea","Type":"ContainerStarted","Data":"701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c"} Nov 04 06:08:49.013151 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:49.013092 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-cxtqr-269jx" podStartSLOduration=1.01306844 podStartE2EDuration="1.01306844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:49.012419931 +0000 UTC m=+1177.509814695" watchObservedRunningTime="2026-11-04 06:08:49.01306844 +0000 UTC m=+1177.510463225" Nov 04 06:08:59.136646 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.136608 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g"] Nov 04 06:08:59.137200 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.137182 4932 cpu_manager.go:414] "containerMap: removing container" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:59.137249 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.137201 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68e39787-663f-4340-b4ae-62350a29f75b" containerName="istio-proxy" Nov 04 06:08:59.137305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.137296 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="11a25c1d-8e92-40b6-8094-8b54f9ef37ba" containerName="istio-proxy" Nov 04 06:08:59.140476 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.140456 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.212187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.212154 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.212341 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.212203 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.212389 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.212335 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8dkq\" (UniqueName: \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.250045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.250014 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:08:59.250045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.250034 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:08:59.253501 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.253476 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g"] Nov 04 06:08:59.313652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.313625 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.313812 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.313667 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.313885 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.313825 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8dkq\" (UniqueName: \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.314370 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.314346 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.315988 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.315967 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.378288 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.378262 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8dkq\" (UniqueName: \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\") pod \"maas-api-revoke-sub-37c23825-nt88g\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.453419 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.453362 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:08:59.841483 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.841455 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g"] Nov 04 06:08:59.841666 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:08:59.841643 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7f535f_2c5a_4578_8ca1_68637ae0ea4e.slice/crio-629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536 WatchSource:0}: Error finding container 629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536: Status 404 returned error can't find the container with id 629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536 Nov 04 06:08:59.969757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:08:59.969710 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" event={"ID":"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e","Type":"ContainerStarted","Data":"629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536"} Nov 04 06:09:00.978867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:00.978831 4932 generic.go:356] "Generic (PLEG): container finished" podID="8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" containerID="b93673d646714c7719c9a41eff17da4d2c6588ac73b7d3c43c0673c9e875f51a" exitCode=0 Nov 04 06:09:00.979294 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:00.978920 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" event={"ID":"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e","Type":"ContainerDied","Data":"b93673d646714c7719c9a41eff17da4d2c6588ac73b7d3c43c0673c9e875f51a"} Nov 04 06:09:02.130076 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.130053 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:09:02.141907 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.141881 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\") pod \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " Nov 04 06:09:02.142053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.141959 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\") pod \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " Nov 04 06:09:02.142053 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.141997 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\" (UniqueName: \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\") pod \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\" (UID: \"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e\") " Nov 04 06:09:02.142217 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.142196 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca" pod "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" (UID: "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:02.142460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.142438 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:02.143976 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.143957 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca" pod "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" (UID: "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:02.144127 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.144113 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq" pod "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" (UID: "8d7f535f-2c5a-4578-8ca1-68637ae0ea4e"). InnerVolumeSpecName "kube-api-access-t8dkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:02.243472 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.243405 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:02.243472 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.243428 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8dkq\" (UniqueName: \"kubernetes.io/projected/8d7f535f-2c5a-4578-8ca1-68637ae0ea4e-kube-api-access-t8dkq\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:02.993954 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.993919 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" Nov 04 06:09:02.994138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.993954 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37c23825-nt88g" event={"ID":"8d7f535f-2c5a-4578-8ca1-68637ae0ea4e","Type":"ContainerDied","Data":"629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536"} Nov 04 06:09:02.994138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:02.994011 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="629b8b7aa079f5dd887c94c17eaa0c97486851745cb899e5cb1082933e751536" Nov 04 06:09:03.470132 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:03.470091 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:09:03.481006 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:03.480979 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:09:11.794150 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:11.794114 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 06:09:11.797484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:11.797460 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2x2d7_be228dc0-014f-43a6-99c9-dfc7cdd45b37/console-operator/3.log" Nov 04 06:09:14.983777 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:14.983738 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x"] Nov 04 06:09:14.984307 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:14.984290 4932 cpu_manager.go:414] "containerMap: removing container" podUID="8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" containerName="revoke-keys" Nov 04 06:09:14.984377 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:14.984308 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" containerName="revoke-keys" Nov 04 06:09:14.984431 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:14.984394 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d7f535f-2c5a-4578-8ca1-68637ae0ea4e" containerName="revoke-keys" Nov 04 06:09:14.989599 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:14.989576 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.049388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.049351 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x"] Nov 04 06:09:15.085268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.085225 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.085430 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.085298 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.085430 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.085383 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98sbq\" (UniqueName: \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.097101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.097072 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:09:15.097101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.097085 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:09:15.186166 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.186136 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.186364 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.186185 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98sbq\" (UniqueName: \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.186364 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.186282 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.186962 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.186932 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.188480 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.188453 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.250557 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.250488 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98sbq\" (UniqueName: \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\") pod \"maas-api-revoke-sub-122919c5-7xh9x\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.303655 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.303616 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:15.717437 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:15.717406 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4224441b_a7fe_4636_bcae_cb3b97a6b3f6.slice/crio-c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62 WatchSource:0}: Error finding container c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62: Status 404 returned error can't find the container with id c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62 Nov 04 06:09:15.717834 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:15.717813 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x"] Nov 04 06:09:16.086704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:16.086663 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" event={"ID":"4224441b-a7fe-4636-bcae-cb3b97a6b3f6","Type":"ContainerStarted","Data":"43eed2f0f3bc8b771d7171237cf68966ecd873f6c4f65f85e9bcb01630a0757a"} Nov 04 06:09:16.087177 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:16.086759 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" event={"ID":"4224441b-a7fe-4636-bcae-cb3b97a6b3f6","Type":"ContainerStarted","Data":"c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62"} Nov 04 06:09:16.211234 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:16.211180 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" podStartSLOduration=2.211162793 podStartE2EDuration="2.211162793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:16.209824378 +0000 UTC m=+1204.707219140" watchObservedRunningTime="2026-11-04 06:09:16.211162793 +0000 UTC m=+1204.708557572" Nov 04 06:09:16.482429 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:16.482395 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:09:16.600839 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:16.600803 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:09:17.125273 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:17.125229 4932 generic.go:356] "Generic (PLEG): container finished" podID="4224441b-a7fe-4636-bcae-cb3b97a6b3f6" containerID="43eed2f0f3bc8b771d7171237cf68966ecd873f6c4f65f85e9bcb01630a0757a" exitCode=0 Nov 04 06:09:17.125772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:17.125439 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" event={"ID":"4224441b-a7fe-4636-bcae-cb3b97a6b3f6","Type":"ContainerDied","Data":"43eed2f0f3bc8b771d7171237cf68966ecd873f6c4f65f85e9bcb01630a0757a"} Nov 04 06:09:17.371674 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:17.371629 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:09:18.415545 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.415472 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:18.490812 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.490644 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerName="main" containerID="cri-o://f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc" gracePeriod=45 Nov 04 06:09:18.508018 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.507848 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerName="main" containerID="cri-o://d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded" gracePeriod=45 Nov 04 06:09:18.561457 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.561422 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\") pod \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " Nov 04 06:09:18.561632 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.561525 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\" (UniqueName: \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\") pod \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " Nov 04 06:09:18.561632 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.561592 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\") pod \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\" (UID: \"4224441b-a7fe-4636-bcae-cb3b97a6b3f6\") " Nov 04 06:09:18.562152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.562129 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca" pod "4224441b-a7fe-4636-bcae-cb3b97a6b3f6" (UID: "4224441b-a7fe-4636-bcae-cb3b97a6b3f6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:18.564566 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.564538 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca" pod "4224441b-a7fe-4636-bcae-cb3b97a6b3f6" (UID: "4224441b-a7fe-4636-bcae-cb3b97a6b3f6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:18.565365 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.565344 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq" pod "4224441b-a7fe-4636-bcae-cb3b97a6b3f6" (UID: "4224441b-a7fe-4636-bcae-cb3b97a6b3f6"). InnerVolumeSpecName "kube-api-access-98sbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:18.663414 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.663337 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98sbq\" (UniqueName: \"kubernetes.io/projected/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-kube-api-access-98sbq\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:18.663414 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.663374 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:18.663414 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.663390 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4224441b-a7fe-4636-bcae-cb3b97a6b3f6-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:18.675369 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.675261 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused" Nov 04 06:09:18.829362 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.829327 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:09:18.861554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.861527 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:09:18.967314 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967285 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.967481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967344 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.967481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967388 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\" (UniqueName: \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967435 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\" (UniqueName: \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967681 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967483 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.967681 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967550 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967681 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967608 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967681 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967665 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967696 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\" (UniqueName: \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.967936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967760 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\") pod \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\" (UID: \"00f26db9-e080-44d8-959a-3b7dba9fe4c6\") " Nov 04 06:09:18.967936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967863 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.967936 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967904 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\") pod \"9a38d712-f7a0-41c0-b069-7fb05f086470\" (UID: \"9a38d712-f7a0-41c0-b069-7fb05f086470\") " Nov 04 06:09:18.968880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967549 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.968880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.967578 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.968880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.968373 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.968880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.968566 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.968880 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.968798 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.969219 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.969101 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.973897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973861 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.973897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973885 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.974047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973905 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "kube-api-access-47d5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:18.974047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973888 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs" pod "9a38d712-f7a0-41c0-b069-7fb05f086470" (UID: "9a38d712-f7a0-41c0-b069-7fb05f086470"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:18.974047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973888 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "kube-api-access-zq6q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:18.974047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:18.973903 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs" pod "00f26db9-e080-44d8-959a-3b7dba9fe4c6" (UID: "00f26db9-e080-44d8-959a-3b7dba9fe4c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:19.069781 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069701 4932 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-model-cache\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069797 4932 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-dshm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069810 4932 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-home\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069819 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47d5p\" (UniqueName: \"kubernetes.io/projected/9a38d712-f7a0-41c0-b069-7fb05f086470-kube-api-access-47d5p\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069828 4932 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tmp-dir\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069836 4932 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38d712-f7a0-41c0-b069-7fb05f086470-tls-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069848 4932 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-tmp-dir\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069861 4932 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-model-cache\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069869 4932 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-home\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069878 4932 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00f26db9-e080-44d8-959a-3b7dba9fe4c6-tls-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069885 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq6q7\" (UniqueName: \"kubernetes.io/projected/00f26db9-e080-44d8-959a-3b7dba9fe4c6-kube-api-access-zq6q7\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.069982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.069893 4932 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38d712-f7a0-41c0-b069-7fb05f086470-dshm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.153867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.148331 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" event={"ID":"4224441b-a7fe-4636-bcae-cb3b97a6b3f6","Type":"ContainerDied","Data":"c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62"} Nov 04 06:09:19.153867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.148367 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-122919c5-7xh9x" Nov 04 06:09:19.153867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.148385 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7ad6b273120d17d5fab12d9db7760dcd487168d34c54809717a2900e797fb62" Nov 04 06:09:19.154205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.154114 4932 generic.go:356] "Generic (PLEG): container finished" podID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerID="d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded" exitCode=0 Nov 04 06:09:19.154205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.154166 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" Nov 04 06:09:19.154205 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.154193 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" event={"ID":"00f26db9-e080-44d8-959a-3b7dba9fe4c6","Type":"ContainerDied","Data":"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded"} Nov 04 06:09:19.154366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.154255 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd" event={"ID":"00f26db9-e080-44d8-959a-3b7dba9fe4c6","Type":"ContainerDied","Data":"e0e97f816f6d5cc9c9cace6969e55ae2f72d4e53b2591560ae53e39f47fe61fd"} Nov 04 06:09:19.154366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.154286 4932 scope.go:122] "RemoveContainer" containerID="d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded" Nov 04 06:09:19.165152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.165121 4932 generic.go:356] "Generic (PLEG): container finished" podID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerID="f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc" exitCode=0 Nov 04 06:09:19.165285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.165170 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" Nov 04 06:09:19.165285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.165175 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" event={"ID":"9a38d712-f7a0-41c0-b069-7fb05f086470","Type":"ContainerDied","Data":"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc"} Nov 04 06:09:19.165285 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.165208 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" event={"ID":"9a38d712-f7a0-41c0-b069-7fb05f086470","Type":"ContainerDied","Data":"161a66adfe10b63db9974d00189bf97c1a3bd8408d2f98d300f8eb69240295b7"} Nov 04 06:09:19.172221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.172203 4932 scope.go:122] "RemoveContainer" containerID="d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded" Nov 04 06:09:19.172763 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:19.172709 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded\": container with ID starting with d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded not found: ID does not exist" containerID="d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded" Nov 04 06:09:19.172863 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.172766 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded"} err="failed to get container status \"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded\": rpc error: code = NotFound desc = could not find container \"d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded\": container with ID starting with d6233c5b92a0c7c28a570da65f5b7eea13dc8f13d1599404b5d81e7dc6f3fded not found: ID does not exist" Nov 04 06:09:19.172863 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.172794 4932 scope.go:122] "RemoveContainer" containerID="f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc" Nov 04 06:09:19.216992 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.216410 4932 scope.go:122] "RemoveContainer" containerID="f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc" Nov 04 06:09:19.217189 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:19.217148 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc\": container with ID starting with f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc not found: ID does not exist" containerID="f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc" Nov 04 06:09:19.217305 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.217192 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc"} err="failed to get container status \"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc\": rpc error: code = NotFound desc = could not find container \"f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc\": container with ID starting with f80e1a6e14144f069eacca11dd112144494368fd1391c944d7f9767d584a28bc not found: ID does not exist" Nov 04 06:09:19.332803 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.332715 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:09:19.336010 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.335986 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h"] Nov 04 06:09:19.511124 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.511085 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:09:19.516289 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.516259 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/premium-w4-856c68-kserve-6cc9b49448-q2zmd"] Nov 04 06:09:19.619543 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.619444 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" path="/var/lib/kubelet/pods/00f26db9-e080-44d8-959a-3b7dba9fe4c6/volumes" Nov 04 06:09:19.620139 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.620074 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" path="/var/lib/kubelet/pods/9a38d712-f7a0-41c0-b069-7fb05f086470/volumes" Nov 04 06:09:19.802984 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:19.802949 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-856c68/distinct-w4-856c68-kserve-77476f847-6d84h" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 04 06:09:21.483583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:21.483527 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" containerID="cri-o://1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576" gracePeriod=25 Nov 04 06:09:21.601074 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:21.601036 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" containerID="cri-o://29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974" gracePeriod=25 Nov 04 06:09:24.193313 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:24.193272 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:09:24.193701 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:24.193292 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:09:28.414600 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.414569 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:09:28.415081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415066 4932 cpu_manager.go:414] "containerMap: removing container" podUID="4224441b-a7fe-4636-bcae-cb3b97a6b3f6" containerName="revoke-keys" Nov 04 06:09:28.415138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415082 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4224441b-a7fe-4636-bcae-cb3b97a6b3f6" containerName="revoke-keys" Nov 04 06:09:28.415138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415108 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerName="main" Nov 04 06:09:28.415138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415114 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerName="main" Nov 04 06:09:28.415138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415137 4932 cpu_manager.go:414] "containerMap: removing container" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerName="main" Nov 04 06:09:28.415254 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415141 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerName="main" Nov 04 06:09:28.415254 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415210 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="4224441b-a7fe-4636-bcae-cb3b97a6b3f6" containerName="revoke-keys" Nov 04 06:09:28.415254 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415221 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="00f26db9-e080-44d8-959a-3b7dba9fe4c6" containerName="main" Nov 04 06:09:28.415254 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.415228 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a38d712-f7a0-41c0-b069-7fb05f086470" containerName="main" Nov 04 06:09:28.420203 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.420186 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.471586 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471548 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.471747 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471600 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.471806 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471788 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlklh\" (UniqueName: \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.471929 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471907 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.471982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471967 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.472024 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.471994 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.479650 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.479623 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:09:28.529136 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.529105 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"kube-root-ca.crt\"" Nov 04 06:09:28.529252 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.529217 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"distinct-2-w2-db31ef-kserve-self-signed-certs\"" Nov 04 06:09:28.530087 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.530072 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"openshift-service-ca.crt\"" Nov 04 06:09:28.530166 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.530155 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"default-dockercfg-v4btb\"" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577348 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577417 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577453 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577498 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577525 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.577626 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlklh\" (UniqueName: \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.578317 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.579101 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.580906 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.579344 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.593228 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.593197 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.593464 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.593291 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.646942 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.646914 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlklh\" (UniqueName: \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\") pod \"distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:28.732269 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:28.732233 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:29.117692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:29.117660 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:09:29.117831 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:29.117766 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod433f4653_021d_4f32_89aa_1f93b493a456.slice/crio-75af32704e89336ce6cdcc24fc28a2742c5dfc3f5ef19b50dc4dce3771baf237 WatchSource:0}: Error finding container 75af32704e89336ce6cdcc24fc28a2742c5dfc3f5ef19b50dc4dce3771baf237: Status 404 returned error can't find the container with id 75af32704e89336ce6cdcc24fc28a2742c5dfc3f5ef19b50dc4dce3771baf237 Nov 04 06:09:29.238484 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:29.238451 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" event={"ID":"433f4653-021d-4f32-89aa-1f93b493a456","Type":"ContainerStarted","Data":"3d915ca00c35bc5a4e15811b0e0ccb3af0a5ec48d322bfa9ee419718a23c56af"} Nov 04 06:09:29.238682 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:29.238501 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" event={"ID":"433f4653-021d-4f32-89aa-1f93b493a456","Type":"ContainerStarted","Data":"75af32704e89336ce6cdcc24fc28a2742c5dfc3f5ef19b50dc4dce3771baf237"} Nov 04 06:09:29.365786 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:29.365681 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" podStartSLOduration=1.365665741 podStartE2EDuration="1.365665741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:29.362298895 +0000 UTC m=+1217.859693658" watchObservedRunningTime="2026-11-04 06:09:29.365665741 +0000 UTC m=+1217.863060528" Nov 04 06:09:29.732537 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:29.732508 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:30.968385 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:30.968355 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:09:30.972266 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:30.972245 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000469 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000406 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000469 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000447 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000641 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000474 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqpl\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000641 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000575 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000641 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000633 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000830 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000787 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000853 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000913 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000900 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.000979 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.000959 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.022015 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.021981 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:09:31.025679 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.025659 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.101949 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.101916 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.102147 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.101958 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.102147 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.101996 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.102147 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102098 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102168 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102249 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102569 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102607 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqpl\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102469 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102635 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102669 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102695 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102764 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102869 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102927 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102963 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102963 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.102990 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.103137 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.103173 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.103224 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4lw\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.103472 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.103826 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.103685 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.104951 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.104926 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.105996 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.105968 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.167845 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.167815 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.168041 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.167864 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqpl\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.189460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.189424 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204425 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204468 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204491 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204541 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204563 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204584 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204606 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4lw\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204638 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.204763 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204676 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.205212 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.204813 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.205343 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.205317 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.205588 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.205568 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.205638 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.205606 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.206086 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.206063 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.207229 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.207204 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.207396 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.207371 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.273646 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.273502 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4lw\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.273868 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.273598 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.288990 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.288960 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:31.328200 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.328171 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:09:31.338740 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.338697 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:31.750692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.750656 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:09:31.751576 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:31.751547 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69a51f0_0660_4b34_ba73_6de055a65bd1.slice/crio-c071cb8a1ea94e938a7d3baf780813ea8ed093513a67dde440141ec3d27dfde1 WatchSource:0}: Error finding container c071cb8a1ea94e938a7d3baf780813ea8ed093513a67dde440141ec3d27dfde1: Status 404 returned error can't find the container with id c071cb8a1ea94e938a7d3baf780813ea8ed093513a67dde440141ec3d27dfde1 Nov 04 06:09:31.754214 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.754169 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:31.754303 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.754261 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:31.754347 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.754307 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:31.807604 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.807576 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:09:31.808444 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:31.808416 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229772c4_ad84_46b6_ab9a_b72520858ae9.slice/crio-6110e6c8985a71af2263ed19f80c24ae2a1e8a44ecda933840e962b32846ac7d WatchSource:0}: Error finding container 6110e6c8985a71af2263ed19f80c24ae2a1e8a44ecda933840e962b32846ac7d: Status 404 returned error can't find the container with id 6110e6c8985a71af2263ed19f80c24ae2a1e8a44ecda933840e962b32846ac7d Nov 04 06:09:31.811067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.811035 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:31.811168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.811104 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:31.811168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:31.811132 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:32.295754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.292883 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" event={"ID":"229772c4-ad84-46b6-ab9a-b72520858ae9","Type":"ContainerStarted","Data":"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10"} Nov 04 06:09:32.295754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.292955 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" event={"ID":"229772c4-ad84-46b6-ab9a-b72520858ae9","Type":"ContainerStarted","Data":"6110e6c8985a71af2263ed19f80c24ae2a1e8a44ecda933840e962b32846ac7d"} Nov 04 06:09:32.296329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.296058 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" event={"ID":"f69a51f0-0660-4b34-ba73-6de055a65bd1","Type":"ContainerStarted","Data":"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8"} Nov 04 06:09:32.296329 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.296109 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" event={"ID":"f69a51f0-0660-4b34-ba73-6de055a65bd1","Type":"ContainerStarted","Data":"c071cb8a1ea94e938a7d3baf780813ea8ed093513a67dde440141ec3d27dfde1"} Nov 04 06:09:32.298760 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.297773 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:32.298898 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.298831 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:32.298898 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.298879 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:32.342750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.342385 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:32.342750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.342538 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:32.342750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.342582 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:32.461751 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.455629 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podStartSLOduration=2.455605011 podStartE2EDuration="2.455605011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:32.439107171 +0000 UTC m=+1220.936501934" watchObservedRunningTime="2026-11-04 06:09:32.455605011 +0000 UTC m=+1220.952999776" Nov 04 06:09:32.585435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:32.585261 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podStartSLOduration=2.585238856 podStartE2EDuration="2.585238856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:32.566217785 +0000 UTC m=+1221.063612550" watchObservedRunningTime="2026-11-04 06:09:32.585238856 +0000 UTC m=+1221.082633622" Nov 04 06:09:33.289644 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:33.289594 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:33.289991 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:33.289942 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:33.340705 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:33.340667 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:33.341332 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:33.341299 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:34.193213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.193178 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:09:34.193379 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.193178 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 06:09:34.289783 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.289750 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:34.289946 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.289806 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:34.344387 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.344350 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:34.345032 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:34.345001 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:35.290198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:35.290062 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:35.290198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:35.290127 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:35.349810 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:35.349142 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:35.349810 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:35.349206 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:36.290003 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:36.289965 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:36.290216 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:36.290018 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:36.344317 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:36.344180 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:36.344317 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:36.344244 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:37.290300 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:37.290260 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:37.290687 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:37.290328 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:37.340272 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:37.340227 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:37.340589 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:37.340559 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:38.291340 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.291295 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body= Nov 04 06:09:38.293154 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.293110 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" Nov 04 06:09:38.340595 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.340553 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Nov 04 06:09:38.340919 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.340885 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Nov 04 06:09:38.732624 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.732578 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:38.746874 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:38.746840 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:39.414705 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.414670 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:09:39.652536 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.652510 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:39.653366 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.653345 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:39.656932 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.654896 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:09:39.665949 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.665882 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:39.666584 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.666553 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:39.667456 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:39.667437 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:09:41.757604 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.757536 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:09:41.835212 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.835177 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\" (UniqueName: \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\") pod \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " Nov 04 06:09:41.835391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.835324 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\") pod \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\" (UID: \"753e8405-d2a6-47ea-b1e0-a80db94ee61f\") " Nov 04 06:09:41.835823 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.835790 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume" pod "753e8405-d2a6-47ea-b1e0-a80db94ee61f" (UID: "753e8405-d2a6-47ea-b1e0-a80db94ee61f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:41.837856 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.837716 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk" pod "753e8405-d2a6-47ea-b1e0-a80db94ee61f" (UID: "753e8405-d2a6-47ea-b1e0-a80db94ee61f"). InnerVolumeSpecName "kube-api-access-9lkgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:41.882138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.882111 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:09:41.936134 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936104 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\") pod \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " Nov 04 06:09:41.936280 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936197 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\" (UniqueName: \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\") pod \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\" (UID: \"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2\") " Nov 04 06:09:41.936445 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936419 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume" pod "0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" (UID: "0826f9bd-a6f0-4dda-ad85-47e2ccb388c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:41.936598 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936583 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lkgk\" (UniqueName: \"kubernetes.io/projected/753e8405-d2a6-47ea-b1e0-a80db94ee61f-kube-api-access-9lkgk\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:41.936643 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936603 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:41.936643 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.936618 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/753e8405-d2a6-47ea-b1e0-a80db94ee61f-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:41.938371 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:41.938344 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6" pod "0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" (UID: "0826f9bd-a6f0-4dda-ad85-47e2ccb388c2"). InnerVolumeSpecName "kube-api-access-k4zc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:42.038008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.037918 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4zc6\" (UniqueName: \"kubernetes.io/projected/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2-kube-api-access-k4zc6\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:42.412834 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.412745 4932 generic.go:356] "Generic (PLEG): container finished" podID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerID="1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576" exitCode=0 Nov 04 06:09:42.412834 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.412799 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" Nov 04 06:09:42.412834 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.412818 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" event={"ID":"753e8405-d2a6-47ea-b1e0-a80db94ee61f","Type":"ContainerDied","Data":"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576"} Nov 04 06:09:42.413045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.412883 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5" event={"ID":"753e8405-d2a6-47ea-b1e0-a80db94ee61f","Type":"ContainerDied","Data":"a25dc915ad7c09cb825f06fd38fece05edfdf76368521734b7738d1bec6fe3ff"} Nov 04 06:09:42.413045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.412909 4932 scope.go:122] "RemoveContainer" containerID="1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576" Nov 04 06:09:42.414359 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.414336 4932 generic.go:356] "Generic (PLEG): container finished" podID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerID="29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974" exitCode=0 Nov 04 06:09:42.414491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.414390 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" Nov 04 06:09:42.414491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.414439 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" event={"ID":"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2","Type":"ContainerDied","Data":"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974"} Nov 04 06:09:42.414491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.414479 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5" event={"ID":"0826f9bd-a6f0-4dda-ad85-47e2ccb388c2","Type":"ContainerDied","Data":"a13150454bdbed6cb3b4e629a9313ac2a725c65d30aac1aed58bb09d589d507d"} Nov 04 06:09:42.424253 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.424230 4932 scope.go:122] "RemoveContainer" containerID="1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576" Nov 04 06:09:42.424554 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:42.424529 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576\": container with ID starting with 1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576 not found: ID does not exist" containerID="1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576" Nov 04 06:09:42.424657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.424558 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576"} err="failed to get container status \"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576\": rpc error: code = NotFound desc = could not find container \"1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576\": container with ID starting with 1007f184656a7146fb7b663b3b3c35d32734ef48a608563edfe66fb8ff7b1576 not found: ID does not exist" Nov 04 06:09:42.424657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.424575 4932 scope.go:122] "RemoveContainer" containerID="29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974" Nov 04 06:09:42.433330 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.433310 4932 scope.go:122] "RemoveContainer" containerID="29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974" Nov 04 06:09:42.433593 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:42.433577 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974\": container with ID starting with 29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974 not found: ID does not exist" containerID="29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974" Nov 04 06:09:42.433633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.433603 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974"} err="failed to get container status \"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974\": rpc error: code = NotFound desc = could not find container \"29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974\": container with ID starting with 29eb836d354746feb34babedb9e337812a373c6062ee674e1359ec3c9dffe974 not found: ID does not exist" Nov 04 06:09:42.589058 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.589034 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:09:42.642890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.642866 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5"] Nov 04 06:09:42.709524 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.709427 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:09:42.720466 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:42.720436 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5"] Nov 04 06:09:43.618633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:43.618593 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" path="/var/lib/kubelet/pods/0826f9bd-a6f0-4dda-ad85-47e2ccb388c2/volumes" Nov 04 06:09:43.619133 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:43.619016 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" path="/var/lib/kubelet/pods/753e8405-d2a6-47ea-b1e0-a80db94ee61f/volumes" Nov 04 06:09:45.704767 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.704718 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:09:45.705509 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705490 4932 cpu_manager.go:414] "containerMap: removing container" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" Nov 04 06:09:45.705559 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705513 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" Nov 04 06:09:45.705559 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705546 4932 cpu_manager.go:414] "containerMap: removing container" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" Nov 04 06:09:45.705559 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705554 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" Nov 04 06:09:45.705699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705687 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="753e8405-d2a6-47ea-b1e0-a80db94ee61f" containerName="payload-processing" Nov 04 06:09:45.705759 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.705709 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="0826f9bd-a6f0-4dda-ad85-47e2ccb388c2" containerName="payload-pre-processing" Nov 04 06:09:45.711304 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.711283 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.756520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.756495 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:09:45.760403 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.760387 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.776543 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776521 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776659 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776563 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776659 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776650 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776784 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776674 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776784 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776693 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776816 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776855 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.776897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776878 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.777058 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.776958 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdxft\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.816178 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.816145 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:09:45.873104 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.873068 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:09:45.878616 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878581 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.878869 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878677 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.878869 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878752 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.878869 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878816 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.879067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878891 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.879067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878930 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.879067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.878991 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkts6\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.879067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.879035 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.879250 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.879083 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.879250 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.879121 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.879972 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.879939 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880129 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880108 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880143 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdxft\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880176 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.880315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880207 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.880315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880271 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880279 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880315 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880306 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.880512 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880395 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880512 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880444 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.880849 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880830 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.880943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.880886 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.881079 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.881063 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.883716 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.883690 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.885449 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.885423 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.952445 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.952417 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.954997 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.954936 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdxft\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:45.981649 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981625 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.981822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981711 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.981822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981767 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.981822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981791 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981829 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981893 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkts6\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982008 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.981952 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982141 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982110 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982112 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982176 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982181 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982379 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982341 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982456 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982422 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.982760 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.982709 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.983952 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.983933 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:45.984566 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:45.984546 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:46.024744 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.024704 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:46.047531 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.047508 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:46.049124 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.049095 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkts6\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:46.076400 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.076371 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:46.488627 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:46.488595 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f414a81_c01e_4a4b_a033_d0076d79e57a.slice/crio-d67bbbcc2c4ce062488b854c46b727df1749e159e6ce9d02e1b70336b2c9953a WatchSource:0}: Error finding container d67bbbcc2c4ce062488b854c46b727df1749e159e6ce9d02e1b70336b2c9953a: Status 404 returned error can't find the container with id d67bbbcc2c4ce062488b854c46b727df1749e159e6ce9d02e1b70336b2c9953a Nov 04 06:09:46.490297 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.490271 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:09:46.491481 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.491438 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:46.491569 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.491547 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:46.491607 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.491593 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:46.494274 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.494182 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:09:46.532013 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:46.531978 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d10a93b_14fe_48be_b817_975acc23dae1.slice/crio-8f1c1da687b719c975785c4068a6a736dc4d6e09531d0cc5bd29116b39ec01e5 WatchSource:0}: Error finding container 8f1c1da687b719c975785c4068a6a736dc4d6e09531d0cc5bd29116b39ec01e5: Status 404 returned error can't find the container with id 8f1c1da687b719c975785c4068a6a736dc4d6e09531d0cc5bd29116b39ec01e5 Nov 04 06:09:46.538652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.535378 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:46.538652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.537833 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:46.538652 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:46.537903 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:09:47.372312 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:47.372274 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:09:47.466202 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.466160 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" event={"ID":"3d10a93b-14fe-48be-b817-975acc23dae1","Type":"ContainerStarted","Data":"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141"} Nov 04 06:09:47.466408 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.466268 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" event={"ID":"3d10a93b-14fe-48be-b817-975acc23dae1","Type":"ContainerStarted","Data":"8f1c1da687b719c975785c4068a6a736dc4d6e09531d0cc5bd29116b39ec01e5"} Nov 04 06:09:47.468468 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.468439 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" event={"ID":"9f414a81-c01e-4a4b-a033-d0076d79e57a","Type":"ContainerStarted","Data":"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f"} Nov 04 06:09:47.468574 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.468486 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" event={"ID":"9f414a81-c01e-4a4b-a033-d0076d79e57a","Type":"ContainerStarted","Data":"d67bbbcc2c4ce062488b854c46b727df1749e159e6ce9d02e1b70336b2c9953a"} Nov 04 06:09:47.650868 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.650771 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" podStartSLOduration=2.650755661 podStartE2EDuration="2.650755661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:47.648569604 +0000 UTC m=+1236.145964368" watchObservedRunningTime="2026-11-04 06:09:47.650755661 +0000 UTC m=+1236.148150429" Nov 04 06:09:47.786181 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:47.786129 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" podStartSLOduration=2.786110089 podStartE2EDuration="2.786110089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:47.784814499 +0000 UTC m=+1236.282209266" watchObservedRunningTime="2026-11-04 06:09:47.786110089 +0000 UTC m=+1236.283504850" Nov 04 06:09:48.031754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.031486 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:09:48.031754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.031628 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body= Nov 04 06:09:48.031754 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.031676 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" Nov 04 06:09:48.077085 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.077047 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:09:48.079002 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.078973 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Nov 04 06:09:48.079134 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.079022 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Nov 04 06:09:48.325934 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.325831 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl"] Nov 04 06:09:48.352242 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.350089 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.385489 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.385415 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl"] Nov 04 06:09:48.417065 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.417034 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:09:48.418101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.418075 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:09:48.460197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.459543 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgjq\" (UniqueName: \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.460197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.459686 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.460197 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.459746 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.561414 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.561375 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgjq\" (UniqueName: \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.561593 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.561483 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.561593 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.561534 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.562320 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.562291 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.566756 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.565147 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.647478 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.647393 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgjq\" (UniqueName: \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\") pod \"maas-api-revoke-sub-9b4dbef1-x4hdl\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:48.669147 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:48.669113 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:49.037757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.037124 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body= Nov 04 06:09:49.037757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.037192 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" Nov 04 06:09:49.077543 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.077509 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Nov 04 06:09:49.077710 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.077583 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Nov 04 06:09:49.153375 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.144534 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl"] Nov 04 06:09:49.157067 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:49.156840 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdd6067_2255_4a82_a5dd_a1dfe662e9eb.slice/crio-57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786 WatchSource:0}: Error finding container 57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786: Status 404 returned error can't find the container with id 57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786 Nov 04 06:09:49.484016 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:49.483982 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" event={"ID":"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb","Type":"ContainerStarted","Data":"57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786"} Nov 04 06:09:50.026247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.025817 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body= Nov 04 06:09:50.026247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.025880 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" Nov 04 06:09:50.077328 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.077272 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Nov 04 06:09:50.077532 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.077353 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Nov 04 06:09:50.493656 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.493623 4932 generic.go:356] "Generic (PLEG): container finished" podID="9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" containerID="f6db62e1c46c6fa7de41f0e70addec676c6d95de969e7f08bb93510fea654b2d" exitCode=0 Nov 04 06:09:50.494164 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.493708 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" event={"ID":"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb","Type":"ContainerDied","Data":"f6db62e1c46c6fa7de41f0e70addec676c6d95de969e7f08bb93510fea654b2d"} Nov 04 06:09:50.875492 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.875452 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:09:50.875757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.875711 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" containerID="cri-o://4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141" gracePeriod=30 Nov 04 06:09:50.886486 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.881038 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:09:50.886486 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.881227 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" containerID="cri-o://0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f" gracePeriod=30 Nov 04 06:09:50.964678 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.964637 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:09:50.964999 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.964980 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:09:50.970012 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.967703 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" containerID="cri-o://d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54" gracePeriod=30 Nov 04 06:09:50.971213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:50.971184 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" containerID="cri-o://e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930" gracePeriod=30 Nov 04 06:09:51.791803 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.791751 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:51.859752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.859204 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\" (UniqueName: \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\") pod \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " Nov 04 06:09:51.859752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.859276 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\") pod \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " Nov 04 06:09:51.859998 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.859894 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca" pod "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" (UID: "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:51.860753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.860253 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\") pod \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\" (UID: \"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb\") " Nov 04 06:09:51.860753 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.860747 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:51.862985 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.862960 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq" pod "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" (UID: "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb"). InnerVolumeSpecName "kube-api-access-ncgjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:51.863268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.863252 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca" pod "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" (UID: "9cdd6067-2255-4a82-a5dd-a1dfe662e9eb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:51.961752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.961519 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncgjq\" (UniqueName: \"kubernetes.io/projected/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-kube-api-access-ncgjq\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:51.961752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.961555 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9cdd6067-2255-4a82-a5dd-a1dfe662e9eb-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:51.966976 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.966896 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:09:51.967142 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:51.966990 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:09:52.225993 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:52.224211 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:09:52.561225 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:52.561139 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" event={"ID":"9cdd6067-2255-4a82-a5dd-a1dfe662e9eb","Type":"ContainerDied","Data":"57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786"} Nov 04 06:09:52.561225 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:52.561191 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57203f37d0918a563e03604aca3787790f9c576c2de516bbeab02e7547314786" Nov 04 06:09:52.561405 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:52.561245 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9b4dbef1-x4hdl" Nov 04 06:09:53.314013 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:53.313964 4932 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:09:53.314911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:53.314591 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:09:55.855059 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.855022 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr"] Nov 04 06:09:55.855956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.855843 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" containerName="revoke-keys" Nov 04 06:09:55.855956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.855867 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" containerName="revoke-keys" Nov 04 06:09:55.856103 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.856019 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cdd6067-2255-4a82-a5dd-a1dfe662e9eb" containerName="revoke-keys" Nov 04 06:09:55.860068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.860049 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:55.905103 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.905069 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:55.905258 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.905115 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s289n\" (UniqueName: \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:55.905258 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.905198 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:55.918790 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.918757 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr"] Nov 04 06:09:55.965858 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.965830 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:09:55.965982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:55.965874 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:09:56.005962 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.005932 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.006039 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.006001 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s289n\" (UniqueName: \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.006094 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.006052 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.006965 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.006937 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.009416 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.009212 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.071951 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.071918 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s289n\" (UniqueName: \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\") pod \"maas-api-revoke-sub-eba7e196-tlrrr\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.170432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.170408 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:09:56.173888 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.173867 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:56.208819 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.208777 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.208971 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.208842 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.208971 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.208883 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209092 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.208983 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209092 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209071 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209199 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209132 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209199 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209162 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209199 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209169 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.209371 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209196 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209371 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209300 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\") pod \"23379c91-82be-4eb2-81e0-f6332bc74467\" (UID: \"23379c91-82be-4eb2-81e0-f6332bc74467\") " Nov 04 06:09:56.209571 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209549 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.209647 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209612 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:56.209999 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.209976 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.210099 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.210013 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.210204 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.210012 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.210527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.210029 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23379c91-82be-4eb2-81e0-f6332bc74467-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.210527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.210149 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.213152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.213127 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:09:56.214168 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.214133 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "kube-api-access-7zfkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.216036 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.216014 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.216138 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.216071 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy" pod "23379c91-82be-4eb2-81e0-f6332bc74467" (UID: "23379c91-82be-4eb2-81e0-f6332bc74467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.260173 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.260148 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:09:56.311412 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311377 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311412 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311413 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311439 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311492 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311541 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311614 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311672 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311705 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.311915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311747 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311812 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\") pod \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\" (UID: \"1c967bf0-4529-4be1-b3e2-06b24c63e3cf\") " Nov 04 06:09:56.311915 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.311894 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:56.312199 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312163 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.312404 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312378 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.312550 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312527 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.312922 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312897 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312925 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312941 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312956 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312972 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.312986 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.313003 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zfkc\" (UniqueName: \"kubernetes.io/projected/23379c91-82be-4eb2-81e0-f6332bc74467-kube-api-access-7zfkc\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313028 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.313019 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.313034 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23379c91-82be-4eb2-81e0-f6332bc74467-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.313051 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.313460 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.313068 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23379c91-82be-4eb2-81e0-f6332bc74467-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.314043 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.314020 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "kube-api-access-ksc98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.314115 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.314081 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:09:56.314163 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.314149 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.314628 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.314600 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token" pod "1c967bf0-4529-4be1-b3e2-06b24c63e3cf" (UID: "1c967bf0-4529-4be1-b3e2-06b24c63e3cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.413824 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.413716 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.413824 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.413768 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksc98\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-kube-api-access-ksc98\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.413824 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.413778 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.413824 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.413787 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c967bf0-4529-4be1-b3e2-06b24c63e3cf-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.566799 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.566762 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr"] Nov 04 06:09:56.567235 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:09:56.567207 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978cf1c5_9493_4a3d_ad8f_10e9383162b4.slice/crio-41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42 WatchSource:0}: Error finding container 41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42: Status 404 returned error can't find the container with id 41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42 Nov 04 06:09:56.593356 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.593327 4932 generic.go:356] "Generic (PLEG): container finished" podID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerID="e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930" exitCode=0 Nov 04 06:09:56.593462 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.593386 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" Nov 04 06:09:56.593462 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.593411 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" event={"ID":"1c967bf0-4529-4be1-b3e2-06b24c63e3cf","Type":"ContainerDied","Data":"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930"} Nov 04 06:09:56.593585 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.593465 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt" event={"ID":"1c967bf0-4529-4be1-b3e2-06b24c63e3cf","Type":"ContainerDied","Data":"0a74b6e17ff14dd09710efbe3409c2e5181557ad7d9afdbdde98937551c68f43"} Nov 04 06:09:56.593585 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.593491 4932 scope.go:122] "RemoveContainer" containerID="e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930" Nov 04 06:09:56.595086 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.595057 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" event={"ID":"978cf1c5-9493-4a3d-ad8f-10e9383162b4","Type":"ContainerStarted","Data":"41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42"} Nov 04 06:09:56.596600 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.596574 4932 generic.go:356] "Generic (PLEG): container finished" podID="23379c91-82be-4eb2-81e0-f6332bc74467" containerID="d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54" exitCode=0 Nov 04 06:09:56.596692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.596624 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" Nov 04 06:09:56.596692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.596647 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" event={"ID":"23379c91-82be-4eb2-81e0-f6332bc74467","Type":"ContainerDied","Data":"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54"} Nov 04 06:09:56.596817 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.596699 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx" event={"ID":"23379c91-82be-4eb2-81e0-f6332bc74467","Type":"ContainerDied","Data":"f032f732fac07cd680b58334a9a868aa5a98b2871d81c4f61638f620b275f593"} Nov 04 06:09:56.611084 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.611063 4932 scope.go:122] "RemoveContainer" containerID="e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930" Nov 04 06:09:56.611381 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:56.611363 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930\": container with ID starting with e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930 not found: ID does not exist" containerID="e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930" Nov 04 06:09:56.611442 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.611389 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930"} err="failed to get container status \"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930\": rpc error: code = NotFound desc = could not find container \"e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930\": container with ID starting with e0815ef21747a11f30ac2ffa2c203e691bb6c827d73148e5b113c5c79814f930 not found: ID does not exist" Nov 04 06:09:56.611442 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.611406 4932 scope.go:122] "RemoveContainer" containerID="d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54" Nov 04 06:09:56.620418 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.620401 4932 scope.go:122] "RemoveContainer" containerID="d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54" Nov 04 06:09:56.620675 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:09:56.620653 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54\": container with ID starting with d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54 not found: ID does not exist" containerID="d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54" Nov 04 06:09:56.620775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.620680 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54"} err="failed to get container status \"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54\": rpc error: code = NotFound desc = could not find container \"d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54\": container with ID starting with d99cb2b1ff478ec827e57c63bf021ac5b3472bc639f1f744f430c09e66401b54 not found: ID does not exist" Nov 04 06:09:56.771930 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.771837 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:09:56.775355 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.775321 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx"] Nov 04 06:09:56.894975 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.894942 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:09:56.900904 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:56.900877 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt"] Nov 04 06:09:57.605599 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:57.605569 4932 generic.go:356] "Generic (PLEG): container finished" podID="978cf1c5-9493-4a3d-ad8f-10e9383162b4" containerID="5e0a3f2f4a2e0143bae7e2d210245a38bfbe786fa54f9afe5f733b24ab3e7ec0" exitCode=0 Nov 04 06:09:57.605755 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:57.605649 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" event={"ID":"978cf1c5-9493-4a3d-ad8f-10e9383162b4","Type":"ContainerDied","Data":"5e0a3f2f4a2e0143bae7e2d210245a38bfbe786fa54f9afe5f733b24ab3e7ec0"} Nov 04 06:09:57.617368 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:57.617347 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" path="/var/lib/kubelet/pods/1c967bf0-4529-4be1-b3e2-06b24c63e3cf/volumes" Nov 04 06:09:57.617846 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:57.617831 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" path="/var/lib/kubelet/pods/23379c91-82be-4eb2-81e0-f6332bc74467/volumes" Nov 04 06:09:58.775077 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.775048 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:09:58.845692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.844857 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\" (UniqueName: \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\") pod \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " Nov 04 06:09:58.845692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.845042 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\") pod \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " Nov 04 06:09:58.845692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.845072 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\") pod \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\" (UID: \"978cf1c5-9493-4a3d-ad8f-10e9383162b4\") " Nov 04 06:09:58.846546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.846220 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca" pod "978cf1c5-9493-4a3d-ad8f-10e9383162b4" (UID: "978cf1c5-9493-4a3d-ad8f-10e9383162b4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:58.865166 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.865065 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n" pod "978cf1c5-9493-4a3d-ad8f-10e9383162b4" (UID: "978cf1c5-9493-4a3d-ad8f-10e9383162b4"). InnerVolumeSpecName "kube-api-access-s289n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:58.866581 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.866520 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca" pod "978cf1c5-9493-4a3d-ad8f-10e9383162b4" (UID: "978cf1c5-9493-4a3d-ad8f-10e9383162b4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:58.946592 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.946560 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:58.946592 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.946589 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/978cf1c5-9493-4a3d-ad8f-10e9383162b4-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:58.946592 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:58.946600 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s289n\" (UniqueName: \"kubernetes.io/projected/978cf1c5-9493-4a3d-ad8f-10e9383162b4-kube-api-access-s289n\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:59.622953 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:59.622911 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" event={"ID":"978cf1c5-9493-4a3d-ad8f-10e9383162b4","Type":"ContainerDied","Data":"41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42"} Nov 04 06:09:59.622953 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:59.622958 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41797e48a6cd81fb3117a2c69d7b2f7379d9abd0f4a7d5e437c0fe585f942b42" Nov 04 06:09:59.623212 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:09:59.622921 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-eba7e196-tlrrr" Nov 04 06:10:00.184195 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:00.184154 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:10:00.950313 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:00.950288 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:10:01.025672 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.025645 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:10:01.068947 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.068914 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.068992 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069028 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069073 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069287 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069181 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069287 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069238 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069287 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069274 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069447 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069292 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.069447 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069318 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069447 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069365 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\") pod \"3d10a93b-14fe-48be-b817-975acc23dae1\" (UID: \"3d10a93b-14fe-48be-b817-975acc23dae1\") " Nov 04 06:10:01.069669 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069643 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.069842 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069818 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.069842 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069834 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.069983 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069857 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.069983 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.069913 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.070063 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.070038 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:01.071360 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.071336 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.071692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.071667 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:01.071692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.071686 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "kube-api-access-jkts6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:01.071849 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.071780 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token" pod "3d10a93b-14fe-48be-b817-975acc23dae1" (UID: "3d10a93b-14fe-48be-b817-975acc23dae1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:01.171271 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171236 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171274 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171292 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10a93b-14fe-48be-b817-975acc23dae1-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171306 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkts6\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-kube-api-access-jkts6\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171321 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10a93b-14fe-48be-b817-975acc23dae1-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171335 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10a93b-14fe-48be-b817-975acc23dae1-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.171381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.171348 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10a93b-14fe-48be-b817-975acc23dae1-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.250198 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.250171 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:10:01.372897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.372815 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.372897 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.372874 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373115 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.372952 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373115 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.372988 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373115 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373011 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373115 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373109 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373157 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373191 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373216 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.373312 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373253 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\") pod \"9f414a81-c01e-4a4b-a033-d0076d79e57a\" (UID: \"9f414a81-c01e-4a4b-a033-d0076d79e57a\") " Nov 04 06:10:01.373491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373274 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.373491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373440 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.373491 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373454 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:01.373627 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373567 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.373705 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373684 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.373774 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373710 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.373774 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373743 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f414a81-c01e-4a4b-a033-d0076d79e57a-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.373774 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373759 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.373934 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.373775 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.375182 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.375156 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:01.375182 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.375175 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "kube-api-access-hdxft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:01.375182 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.375156 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:01.375365 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.375350 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo" pod "9f414a81-c01e-4a4b-a033-d0076d79e57a" (UID: "9f414a81-c01e-4a4b-a033-d0076d79e57a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:01.474518 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.474485 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.474518 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.474520 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.474706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.474537 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdxft\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-kube-api-access-hdxft\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.474706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.474551 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f414a81-c01e-4a4b-a033-d0076d79e57a-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.637611 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.637580 4932 generic.go:356] "Generic (PLEG): container finished" podID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerID="0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f" exitCode=0 Nov 04 06:10:01.637717 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.637620 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" Nov 04 06:10:01.637717 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.637663 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" event={"ID":"9f414a81-c01e-4a4b-a033-d0076d79e57a","Type":"ContainerDied","Data":"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f"} Nov 04 06:10:01.637717 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.637713 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m" event={"ID":"9f414a81-c01e-4a4b-a033-d0076d79e57a","Type":"ContainerDied","Data":"d67bbbcc2c4ce062488b854c46b727df1749e159e6ce9d02e1b70336b2c9953a"} Nov 04 06:10:01.637837 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.637755 4932 scope.go:122] "RemoveContainer" containerID="0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f" Nov 04 06:10:01.639522 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.639489 4932 generic.go:356] "Generic (PLEG): container finished" podID="3d10a93b-14fe-48be-b817-975acc23dae1" containerID="4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141" exitCode=0 Nov 04 06:10:01.639645 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.639540 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" event={"ID":"3d10a93b-14fe-48be-b817-975acc23dae1","Type":"ContainerDied","Data":"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141"} Nov 04 06:10:01.639645 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.639555 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" Nov 04 06:10:01.639645 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.639576 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg" event={"ID":"3d10a93b-14fe-48be-b817-975acc23dae1","Type":"ContainerDied","Data":"8f1c1da687b719c975785c4068a6a736dc4d6e09531d0cc5bd29116b39ec01e5"} Nov 04 06:10:01.648861 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.648844 4932 scope.go:122] "RemoveContainer" containerID="0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f" Nov 04 06:10:01.649143 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:01.649122 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f\": container with ID starting with 0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f not found: ID does not exist" containerID="0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f" Nov 04 06:10:01.649218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.649154 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f"} err="failed to get container status \"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f\": rpc error: code = NotFound desc = could not find container \"0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f\": container with ID starting with 0cd0ad4347df53ff93026426559069fdc196690d41f2a289ad6b7278b1f6018f not found: ID does not exist" Nov 04 06:10:01.649218 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.649178 4932 scope.go:122] "RemoveContainer" containerID="4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141" Nov 04 06:10:01.660395 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.660379 4932 scope.go:122] "RemoveContainer" containerID="4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141" Nov 04 06:10:01.660653 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:01.660629 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141\": container with ID starting with 4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141 not found: ID does not exist" containerID="4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141" Nov 04 06:10:01.660793 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.660660 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141"} err="failed to get container status \"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141\": rpc error: code = NotFound desc = could not find container \"4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141\": container with ID starting with 4ca84abdba2826c9dfec3ab78ded7493d4d34fff1385d53552fe6dc098c12141 not found: ID does not exist" Nov 04 06:10:01.814883 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.814846 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:10:01.868974 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.868944 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m"] Nov 04 06:10:01.938045 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.937959 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:10:01.947668 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:01.947625 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg"] Nov 04 06:10:03.618415 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:03.618379 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" path="/var/lib/kubelet/pods/3d10a93b-14fe-48be-b817-975acc23dae1/volumes" Nov 04 06:10:03.618874 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:03.618859 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" path="/var/lib/kubelet/pods/9f414a81-c01e-4a4b-a033-d0076d79e57a/volumes" Nov 04 06:10:07.287337 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.287292 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" podUID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" containerName="main" containerID="cri-o://83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0" gracePeriod=45 Nov 04 06:10:07.549648 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.549583 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:10:07.554874 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.554845 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z"] Nov 04 06:10:07.555350 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555335 4932 cpu_manager.go:414] "containerMap: removing container" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" Nov 04 06:10:07.555391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555352 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" Nov 04 06:10:07.555391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555369 4932 cpu_manager.go:414] "containerMap: removing container" podUID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" containerName="main" Nov 04 06:10:07.555391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555374 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" containerName="main" Nov 04 06:10:07.555391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555389 4932 cpu_manager.go:414] "containerMap: removing container" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555394 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555411 4932 cpu_manager.go:414] "containerMap: removing container" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555416 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555429 4932 cpu_manager.go:414] "containerMap: removing container" podUID="978cf1c5-9493-4a3d-ad8f-10e9383162b4" containerName="revoke-keys" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555434 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="978cf1c5-9493-4a3d-ad8f-10e9383162b4" containerName="revoke-keys" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555441 4932 cpu_manager.go:414] "containerMap: removing container" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" Nov 04 06:10:07.555511 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555447 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555516 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f414a81-c01e-4a4b-a033-d0076d79e57a" containerName="istio-proxy" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555527 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c967bf0-4529-4be1-b3e2-06b24c63e3cf" containerName="istio-proxy" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555533 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" containerName="main" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555539 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="978cf1c5-9493-4a3d-ad8f-10e9383162b4" containerName="revoke-keys" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555545 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="23379c91-82be-4eb2-81e0-f6332bc74467" containerName="istio-proxy" Nov 04 06:10:07.555699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.555550 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d10a93b-14fe-48be-b817-975acc23dae1" containerName="istio-proxy" Nov 04 06:10:07.558784 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.558766 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.636633 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636603 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.636829 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636700 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.636829 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636765 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.636829 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636810 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\" (UniqueName: \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.637011 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636887 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.637011 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636936 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\" (UniqueName: \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\") pod \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\" (UID: \"efcaf78b-e143-4700-8cd0-a1aa2533d6e9\") " Nov 04 06:10:07.637011 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.636944 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.637165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.637010 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.637165 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.637057 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.637268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.637179 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpxs\" (UniqueName: \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.637268 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.637235 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.638526 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.638127 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.638526 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.638387 4932 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-model-cache\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.649772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.638792 4932 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-home\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.649772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.638825 4932 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tmp-dir\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.649772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.642862 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.649772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.642970 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "kube-api-access-2t9l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:07.649772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.644807 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs" pod "efcaf78b-e143-4700-8cd0-a1aa2533d6e9" (UID: "efcaf78b-e143-4700-8cd0-a1aa2533d6e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:07.663122 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.663059 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:10:07.663288 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.663140 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:10:07.668702 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.668668 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z"] Nov 04 06:10:07.685701 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.685667 4932 generic.go:356] "Generic (PLEG): container finished" podID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" containerID="83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0" exitCode=0 Nov 04 06:10:07.685890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.685765 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" Nov 04 06:10:07.685890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.685772 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" event={"ID":"efcaf78b-e143-4700-8cd0-a1aa2533d6e9","Type":"ContainerDied","Data":"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0"} Nov 04 06:10:07.685890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.685813 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz" event={"ID":"efcaf78b-e143-4700-8cd0-a1aa2533d6e9","Type":"ContainerDied","Data":"af2e25e9a81bc8a04de0676e88c0969e244d4d4b516f09c237dce1510a0e0571"} Nov 04 06:10:07.685890 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.685833 4932 scope.go:122] "RemoveContainer" containerID="83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0" Nov 04 06:10:07.697769 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.697718 4932 scope.go:122] "RemoveContainer" containerID="83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0" Nov 04 06:10:07.698038 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:07.698019 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0\": container with ID starting with 83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0 not found: ID does not exist" containerID="83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0" Nov 04 06:10:07.698108 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.698045 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0"} err="failed to get container status \"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0\": rpc error: code = NotFound desc = could not find container \"83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0\": container with ID starting with 83098345709b0fe40d2a2c873a88b52d0a61ebac11effd97ebfd4d733a80f0a0 not found: ID does not exist" Nov 04 06:10:07.740087 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740053 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.740267 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740167 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpxs\" (UniqueName: \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.740267 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740221 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.740405 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740364 4932 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-tls-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.740405 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740383 4932 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-dshm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.740405 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740398 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t9l7\" (UniqueName: \"kubernetes.io/projected/efcaf78b-e143-4700-8cd0-a1aa2533d6e9-kube-api-access-2t9l7\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.740842 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.740813 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.743654 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.743624 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.805092 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.805016 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpxs\" (UniqueName: \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\") pod \"maas-api-revoke-sub-bfca4dba-zqk8z\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.872147 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.872114 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:07.915030 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.914994 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:10:07.922706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:07.922675 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/premium-w0-f38f69-kserve-7dcc5cb54b-66llz"] Nov 04 06:10:08.265542 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:08.265511 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z"] Nov 04 06:10:08.265875 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:10:08.265856 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa23432_e998_4bd6_908a_11262c6389e0.slice/crio-b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2 WatchSource:0}: Error finding container b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2: Status 404 returned error can't find the container with id b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2 Nov 04 06:10:08.695619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:08.695525 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" event={"ID":"3fa23432-e998-4bd6-908a-11262c6389e0","Type":"ContainerStarted","Data":"e9d1c2c52317f0e9f69208da01499d45cb41f8ea56a154793258074fa7310712"} Nov 04 06:10:08.695619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:08.695611 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" event={"ID":"3fa23432-e998-4bd6-908a-11262c6389e0","Type":"ContainerStarted","Data":"b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2"} Nov 04 06:10:08.819132 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:08.819022 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" podStartSLOduration=1.8190057020000001 podStartE2EDuration="1.819005702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:10:08.818354898 +0000 UTC m=+1257.315749663" watchObservedRunningTime="2026-11-04 06:10:08.819005702 +0000 UTC m=+1257.316400467" Nov 04 06:10:09.618244 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:09.618205 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efcaf78b-e143-4700-8cd0-a1aa2533d6e9" path="/var/lib/kubelet/pods/efcaf78b-e143-4700-8cd0-a1aa2533d6e9/volumes" Nov 04 06:10:09.703919 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:09.703884 4932 generic.go:356] "Generic (PLEG): container finished" podID="3fa23432-e998-4bd6-908a-11262c6389e0" containerID="e9d1c2c52317f0e9f69208da01499d45cb41f8ea56a154793258074fa7310712" exitCode=0 Nov 04 06:10:09.704273 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:09.703966 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" event={"ID":"3fa23432-e998-4bd6-908a-11262c6389e0","Type":"ContainerDied","Data":"e9d1c2c52317f0e9f69208da01499d45cb41f8ea56a154793258074fa7310712"} Nov 04 06:10:10.856430 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.856403 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:10.989104 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.989071 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\" (UniqueName: \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\") pod \"3fa23432-e998-4bd6-908a-11262c6389e0\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " Nov 04 06:10:10.989292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.989125 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\") pod \"3fa23432-e998-4bd6-908a-11262c6389e0\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " Nov 04 06:10:10.989292 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.989151 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\") pod \"3fa23432-e998-4bd6-908a-11262c6389e0\" (UID: \"3fa23432-e998-4bd6-908a-11262c6389e0\") " Nov 04 06:10:10.989620 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.989587 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca" pod "3fa23432-e998-4bd6-908a-11262c6389e0" (UID: "3fa23432-e998-4bd6-908a-11262c6389e0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:10.991357 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.991324 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs" pod "3fa23432-e998-4bd6-908a-11262c6389e0" (UID: "3fa23432-e998-4bd6-908a-11262c6389e0"). InnerVolumeSpecName "kube-api-access-gbpxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:10.991477 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:10.991402 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca" pod "3fa23432-e998-4bd6-908a-11262c6389e0" (UID: "3fa23432-e998-4bd6-908a-11262c6389e0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:11.090088 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.090060 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbpxs\" (UniqueName: \"kubernetes.io/projected/3fa23432-e998-4bd6-908a-11262c6389e0-kube-api-access-gbpxs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:11.090088 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.090084 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:11.090260 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.090094 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3fa23432-e998-4bd6-908a-11262c6389e0-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:11.718938 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.718902 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" event={"ID":"3fa23432-e998-4bd6-908a-11262c6389e0","Type":"ContainerDied","Data":"b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2"} Nov 04 06:10:11.719112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.718990 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7b67de16ba3b338410adcfc8435118920edbb5de35c4b038d9e22b0ddcc67e2" Nov 04 06:10:11.719112 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:11.718916 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bfca4dba-zqk8z" Nov 04 06:10:15.178638 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.178595 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:10:15.212096 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.212001 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" containerID="cri-o://3d915ca00c35bc5a4e15811b0e0ccb3af0a5ec48d322bfa9ee419718a23c56af" gracePeriod=45 Nov 04 06:10:15.268225 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.268182 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5"] Nov 04 06:10:15.269132 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.269107 4932 cpu_manager.go:414] "containerMap: removing container" podUID="3fa23432-e998-4bd6-908a-11262c6389e0" containerName="revoke-keys" Nov 04 06:10:15.269272 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.269255 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fa23432-e998-4bd6-908a-11262c6389e0" containerName="revoke-keys" Nov 04 06:10:15.269554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.269536 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fa23432-e998-4bd6-908a-11262c6389e0" containerName="revoke-keys" Nov 04 06:10:15.291879 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.291082 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.302770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.302743 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:10:15.350110 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.349984 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 06:10:15.364062 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.363024 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gkllh\"" Nov 04 06:10:15.413033 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.389051 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.413033 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.389134 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fcbc\" (UniqueName: \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.413033 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.389254 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.425381 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.424899 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": dial tcp 10.132.0.94:8000: connect: connection refused" Nov 04 06:10:15.474937 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.474779 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5"] Nov 04 06:10:15.514740 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.492526 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.514740 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.492575 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.514740 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.492648 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fcbc\" (UniqueName: \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.514740 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.494131 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.593751 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.582147 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:15.806188 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.806092 4932 generic.go:356] "Generic (PLEG): container finished" podID="433f4653-021d-4f32-89aa-1f93b493a456" containerID="3d915ca00c35bc5a4e15811b0e0ccb3af0a5ec48d322bfa9ee419718a23c56af" exitCode=0 Nov 04 06:10:15.806482 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.806458 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" event={"ID":"433f4653-021d-4f32-89aa-1f93b493a456","Type":"ContainerDied","Data":"3d915ca00c35bc5a4e15811b0e0ccb3af0a5ec48d322bfa9ee419718a23c56af"} Nov 04 06:10:15.907103 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:15.907050 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fcbc\" (UniqueName: \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\") pod \"maas-api-revoke-sub-cd1cb4f0-mclv5\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:16.216807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:16.207997 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:17.054413 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.054077 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273051 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273187 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\" (UniqueName: \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273265 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273323 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273360 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\" (UniqueName: \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.273750 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.273403 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\") pod \"433f4653-021d-4f32-89aa-1f93b493a456\" (UID: \"433f4653-021d-4f32-89aa-1f93b493a456\") " Nov 04 06:10:17.286758 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.278136 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:17.328766 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.320113 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:17.447066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.427542 4932 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-model-cache\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.447066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.427606 4932 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-tmp-dir\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.447066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.428307 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" probeResult="failure" output="Get \"https://10.132.0.94:8000/ready\": context deadline exceeded" Nov 04 06:10:17.447066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.428412 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:10:17.447066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.446902 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:17.480047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.479185 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "kube-api-access-hlklh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:17.480204 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.480131 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:17.482706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.482665 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm" pod "433f4653-021d-4f32-89aa-1f93b493a456" (UID: "433f4653-021d-4f32-89aa-1f93b493a456"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:17.485577 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.485536 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:17.487749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.487018 4932 cpu_manager.go:414] "containerMap: removing container" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" Nov 04 06:10:17.487749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.487039 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" Nov 04 06:10:17.487749 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.487176 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="433f4653-021d-4f32-89aa-1f93b493a456" containerName="main" Nov 04 06:10:17.492450 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.491605 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.504598 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.504566 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:17.504961 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:17.504935 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:10:17.529151 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.528519 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlklh\" (UniqueName: \"kubernetes.io/projected/433f4653-021d-4f32-89aa-1f93b493a456-kube-api-access-hlklh\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.529151 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.528553 4932 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-home\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.529151 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.528570 4932 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/433f4653-021d-4f32-89aa-1f93b493a456-dshm\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.529151 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.528583 4932 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433f4653-021d-4f32-89aa-1f93b493a456-tls-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:17.629379 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629284 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629379 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629348 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629379 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629376 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629431 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629465 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629509 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629545 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629588 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.629807 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.629632 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgr6j\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.660892 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.660745 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5"] Nov 04 06:10:17.662866 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:10:17.662829 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04883008_4d54_4812_93de_7a5f7c672406.slice/crio-e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4 WatchSource:0}: Error finding container e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4: Status 404 returned error can't find the container with id e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4 Nov 04 06:10:17.730281 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730248 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgr6j\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730415 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730355 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730415 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730411 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730436 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730494 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730530 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730707 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730576 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730707 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730611 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.730707 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.730659 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.731116 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.731082 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.732066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.732027 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.732623 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.732601 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.734034 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.733203 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.734034 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.733452 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.737787 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.737054 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.738352 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.738310 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.797318 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.797259 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgr6j\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:17.895454 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:17.895335 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:18.062385 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.062354 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" Nov 04 06:10:18.062571 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.062348 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc" event={"ID":"433f4653-021d-4f32-89aa-1f93b493a456","Type":"ContainerDied","Data":"75af32704e89336ce6cdcc24fc28a2742c5dfc3f5ef19b50dc4dce3771baf237"} Nov 04 06:10:18.062571 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.062514 4932 scope.go:122] "RemoveContainer" containerID="3d915ca00c35bc5a4e15811b0e0ccb3af0a5ec48d322bfa9ee419718a23c56af" Nov 04 06:10:18.065822 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.065794 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" event={"ID":"04883008-4d54-4812-93de-7a5f7c672406","Type":"ContainerStarted","Data":"c7383bafe209407e488fea1ec4c30eb5321ad950548087419500214b4df0e995"} Nov 04 06:10:18.065959 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.065842 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" event={"ID":"04883008-4d54-4812-93de-7a5f7c672406","Type":"ContainerStarted","Data":"e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4"} Nov 04 06:10:18.133399 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.133355 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:18.240391 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.240306 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:10:18.245318 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.245289 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-2-w2-db31ef-kserve-5548df96cc-qrhgc"] Nov 04 06:10:18.362911 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.362852 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" podStartSLOduration=3.362837421 podStartE2EDuration="3.362837421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:10:18.362022384 +0000 UTC m=+1266.859417149" watchObservedRunningTime="2026-11-04 06:10:18.362837421 +0000 UTC m=+1266.860232184" Nov 04 06:10:18.588594 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:10:18.588561 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15019fc9_9fcf_4853_bf8d_1dd2dcc30dac.slice/crio-1ed154143650d5829ba3b1da08c9450153045738515878d0f63b64bca3f00a67 WatchSource:0}: Error finding container 1ed154143650d5829ba3b1da08c9450153045738515878d0f63b64bca3f00a67: Status 404 returned error can't find the container with id 1ed154143650d5829ba3b1da08c9450153045738515878d0f63b64bca3f00a67 Nov 04 06:10:18.589269 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.589245 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:18.590839 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.590809 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:10:18.590908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.590873 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:10:18.590908 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:18.590902 4932 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Nov 04 06:10:19.076979 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.076945 4932 generic.go:356] "Generic (PLEG): container finished" podID="04883008-4d54-4812-93de-7a5f7c672406" containerID="c7383bafe209407e488fea1ec4c30eb5321ad950548087419500214b4df0e995" exitCode=0 Nov 04 06:10:19.077182 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.077025 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" event={"ID":"04883008-4d54-4812-93de-7a5f7c672406","Type":"ContainerDied","Data":"c7383bafe209407e488fea1ec4c30eb5321ad950548087419500214b4df0e995"} Nov 04 06:10:19.078646 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.078621 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" event={"ID":"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac","Type":"ContainerStarted","Data":"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc"} Nov 04 06:10:19.078773 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.078669 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" event={"ID":"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac","Type":"ContainerStarted","Data":"1ed154143650d5829ba3b1da08c9450153045738515878d0f63b64bca3f00a67"} Nov 04 06:10:19.134018 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.133985 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:19.135471 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.135438 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:19.135605 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.135497 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:19.340982 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.340865 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podStartSLOduration=2.340844 podStartE2EDuration="2.340844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:10:19.337177163 +0000 UTC m=+1267.834571926" watchObservedRunningTime="2026-11-04 06:10:19.340844 +0000 UTC m=+1267.838238765" Nov 04 06:10:19.628332 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:19.628250 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="433f4653-021d-4f32-89aa-1f93b493a456" path="/var/lib/kubelet/pods/433f4653-021d-4f32-89aa-1f93b493a456/volumes" Nov 04 06:10:20.135221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.135182 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:20.135435 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.135248 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:20.180976 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.180933 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" podUID="64c88e0a-7571-40ce-abce-97dec74c05a3" containerName="payload-processing" containerID="cri-o://a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec" gracePeriod=25 Nov 04 06:10:20.338590 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.338521 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" podUID="d04e9516-c1bb-4645-8730-12a1bffa593d" containerName="payload-pre-processing" containerID="cri-o://d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f" gracePeriod=25 Nov 04 06:10:20.444078 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.443677 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:20.542544 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.542512 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:10:20.559068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.558501 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\") pod \"04883008-4d54-4812-93de-7a5f7c672406\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " Nov 04 06:10:20.559068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.558552 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\" (UniqueName: \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\") pod \"04883008-4d54-4812-93de-7a5f7c672406\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " Nov 04 06:10:20.559068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.558683 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\") pod \"04883008-4d54-4812-93de-7a5f7c672406\" (UID: \"04883008-4d54-4812-93de-7a5f7c672406\") " Nov 04 06:10:20.559282 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.559108 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca" pod "04883008-4d54-4812-93de-7a5f7c672406" (UID: "04883008-4d54-4812-93de-7a5f7c672406"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:20.561191 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.561151 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc" pod "04883008-4d54-4812-93de-7a5f7c672406" (UID: "04883008-4d54-4812-93de-7a5f7c672406"). InnerVolumeSpecName "kube-api-access-6fcbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:20.561591 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.561562 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca" pod "04883008-4d54-4812-93de-7a5f7c672406" (UID: "04883008-4d54-4812-93de-7a5f7c672406"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:20.659593 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.659511 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\" (UniqueName: \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\") pod \"64c88e0a-7571-40ce-abce-97dec74c05a3\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " Nov 04 06:10:20.660068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.659612 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\") pod \"64c88e0a-7571-40ce-abce-97dec74c05a3\" (UID: \"64c88e0a-7571-40ce-abce-97dec74c05a3\") " Nov 04 06:10:20.660068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.659829 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04883008-4d54-4812-93de-7a5f7c672406-maas-api-openshift-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.660068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.659843 4932 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04883008-4d54-4812-93de-7a5f7c672406-maas-api-xks-ca\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.660068 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.659854 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fcbc\" (UniqueName: \"kubernetes.io/projected/04883008-4d54-4812-93de-7a5f7c672406-kube-api-access-6fcbc\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.660229 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.660081 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume" pod "64c88e0a-7571-40ce-abce-97dec74c05a3" (UID: "64c88e0a-7571-40ce-abce-97dec74c05a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:20.661706 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.661682 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v" pod "64c88e0a-7571-40ce-abce-97dec74c05a3" (UID: "64c88e0a-7571-40ce-abce-97dec74c05a3"). InnerVolumeSpecName "kube-api-access-d565v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:20.672012 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.671987 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:10:20.760546 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.760508 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\") pod \"d04e9516-c1bb-4645-8730-12a1bffa593d\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " Nov 04 06:10:20.760720 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.760576 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\" (UniqueName: \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\") pod \"d04e9516-c1bb-4645-8730-12a1bffa593d\" (UID: \"d04e9516-c1bb-4645-8730-12a1bffa593d\") " Nov 04 06:10:20.760883 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.760859 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume" pod "d04e9516-c1bb-4645-8730-12a1bffa593d" (UID: "d04e9516-c1bb-4645-8730-12a1bffa593d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:20.761152 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.761133 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64c88e0a-7571-40ce-abce-97dec74c05a3-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.761208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.761159 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d565v\" (UniqueName: \"kubernetes.io/projected/64c88e0a-7571-40ce-abce-97dec74c05a3-kube-api-access-d565v\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.761208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.761175 4932 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04e9516-c1bb-4645-8730-12a1bffa593d-plugins-config-volume\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:20.762769 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.762745 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw" pod "d04e9516-c1bb-4645-8730-12a1bffa593d" (UID: "d04e9516-c1bb-4645-8730-12a1bffa593d"). InnerVolumeSpecName "kube-api-access-7sdpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:20.862382 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:20.862350 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sdpw\" (UniqueName: \"kubernetes.io/projected/d04e9516-c1bb-4645-8730-12a1bffa593d-kube-api-access-7sdpw\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:21.114752 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.113791 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" Nov 04 06:10:21.119921 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.119802 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cd1cb4f0-mclv5" event={"ID":"04883008-4d54-4812-93de-7a5f7c672406","Type":"ContainerDied","Data":"e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4"} Nov 04 06:10:21.119921 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.119880 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9693786d718afd35c89f943d6755831a4c45972bc9cff6d4ea6121a127cc7f4" Nov 04 06:10:21.122021 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.121995 4932 generic.go:356] "Generic (PLEG): container finished" podID="d04e9516-c1bb-4645-8730-12a1bffa593d" containerID="d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f" exitCode=0 Nov 04 06:10:21.122208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.122192 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" Nov 04 06:10:21.122648 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.122233 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" event={"ID":"d04e9516-c1bb-4645-8730-12a1bffa593d","Type":"ContainerDied","Data":"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f"} Nov 04 06:10:21.122799 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.122681 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd" event={"ID":"d04e9516-c1bb-4645-8730-12a1bffa593d","Type":"ContainerDied","Data":"ecbd8a68e5901cd0353be5267f1764909872f56038f82553cfc46270f071f0c6"} Nov 04 06:10:21.122799 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.122718 4932 scope.go:122] "RemoveContainer" containerID="d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f" Nov 04 06:10:21.124747 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.124576 4932 generic.go:356] "Generic (PLEG): container finished" podID="64c88e0a-7571-40ce-abce-97dec74c05a3" containerID="a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec" exitCode=0 Nov 04 06:10:21.124747 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.124640 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" Nov 04 06:10:21.124843 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.124642 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" event={"ID":"64c88e0a-7571-40ce-abce-97dec74c05a3","Type":"ContainerDied","Data":"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec"} Nov 04 06:10:21.124843 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.124797 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n" event={"ID":"64c88e0a-7571-40ce-abce-97dec74c05a3","Type":"ContainerDied","Data":"f0846a8f184651884d03c07e36fafbe351ba166000a762b74682959f1178d84a"} Nov 04 06:10:21.133678 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.133651 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:21.133798 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.133715 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:21.136208 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.136191 4932 scope.go:122] "RemoveContainer" containerID="d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f" Nov 04 06:10:21.136584 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:21.136564 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f\": container with ID starting with d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f not found: ID does not exist" containerID="d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f" Nov 04 06:10:21.136660 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.136592 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f"} err="failed to get container status \"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f\": rpc error: code = NotFound desc = could not find container \"d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f\": container with ID starting with d9468a5dd6f0e129f882efbdc881145cc866352516db6a3282dc13969b21425f not found: ID does not exist" Nov 04 06:10:21.136660 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.136611 4932 scope.go:122] "RemoveContainer" containerID="a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec" Nov 04 06:10:21.145400 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.145380 4932 scope.go:122] "RemoveContainer" containerID="a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec" Nov 04 06:10:21.145642 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:21.145624 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec\": container with ID starting with a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec not found: ID does not exist" containerID="a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec" Nov 04 06:10:21.145693 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.145649 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec"} err="failed to get container status \"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec\": rpc error: code = NotFound desc = could not find container \"a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec\": container with ID starting with a8d48cd6b982363313d6303b232dafc97dcbcd142996fefacabe9ac7c28063ec not found: ID does not exist" Nov 04 06:10:21.325060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.325011 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:10:21.328430 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.328404 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd"] Nov 04 06:10:21.435935 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.435855 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:10:21.439602 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.439575 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n"] Nov 04 06:10:21.627560 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.627528 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64c88e0a-7571-40ce-abce-97dec74c05a3" path="/var/lib/kubelet/pods/64c88e0a-7571-40ce-abce-97dec74c05a3/volumes" Nov 04 06:10:21.627960 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:21.627945 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d04e9516-c1bb-4645-8730-12a1bffa593d" path="/var/lib/kubelet/pods/d04e9516-c1bb-4645-8730-12a1bffa593d/volumes" Nov 04 06:10:22.133710 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:22.133682 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:22.134189 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:22.133750 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:23.134034 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:23.133998 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:23.134463 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:23.134069 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:24.134186 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:24.134149 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:24.134586 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:24.134219 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:25.134555 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:25.134479 4932 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Nov 04 06:10:25.134555 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:25.134545 4932 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Nov 04 06:10:25.159935 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:25.159894 4932 generic.go:356] "Generic (PLEG): container finished" podID="50034b21-7861-46ed-81eb-c71bdf4ffeea" containerID="4388542057ac86394d435a9416af63bfdd5d54601d4ae23de4d90f222d098ce1" exitCode=0 Nov 04 06:10:25.160081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:25.159973 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-cxtqr-269jx" event={"ID":"50034b21-7861-46ed-81eb-c71bdf4ffeea","Type":"ContainerDied","Data":"4388542057ac86394d435a9416af63bfdd5d54601d4ae23de4d90f222d098ce1"} Nov 04 06:10:26.139338 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.139302 4932 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:26.139864 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.139844 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:26.140451 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.140433 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:26.392073 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.388900 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:10:26.447452 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.447425 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\") pod \"50034b21-7861-46ed-81eb-c71bdf4ffeea\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " Nov 04 06:10:26.447452 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.447459 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\") pod \"50034b21-7861-46ed-81eb-c71bdf4ffeea\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " Nov 04 06:10:26.447653 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.447495 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\" (UniqueName: \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\") pod \"50034b21-7861-46ed-81eb-c71bdf4ffeea\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " Nov 04 06:10:26.447851 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.447825 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path" pod "50034b21-7861-46ed-81eb-c71bdf4ffeea" (UID: "50034b21-7861-46ed-81eb-c71bdf4ffeea"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:26.447886 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.447858 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle" pod "50034b21-7861-46ed-81eb-c71bdf4ffeea" (UID: "50034b21-7861-46ed-81eb-c71bdf4ffeea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:26.449667 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.449627 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn" pod "50034b21-7861-46ed-81eb-c71bdf4ffeea" (UID: "50034b21-7861-46ed-81eb-c71bdf4ffeea"). InnerVolumeSpecName "kube-api-access-bngbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:26.548153 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.548122 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\") pod \"50034b21-7861-46ed-81eb-c71bdf4ffeea\" (UID: \"50034b21-7861-46ed-81eb-c71bdf4ffeea\") " Nov 04 06:10:26.548399 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.548383 4932 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/50034b21-7861-46ed-81eb-c71bdf4ffeea-archives-path\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:26.548399 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.548399 4932 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-trusted-ca-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:26.548545 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.548408 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bngbn\" (UniqueName: \"kubernetes.io/projected/50034b21-7861-46ed-81eb-c71bdf4ffeea-kube-api-access-bngbn\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:26.548545 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.548488 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle" pod "50034b21-7861-46ed-81eb-c71bdf4ffeea" (UID: "50034b21-7861-46ed-81eb-c71bdf4ffeea"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:26.649086 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:26.648997 4932 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50034b21-7861-46ed-81eb-c71bdf4ffeea-service-ca-bundle\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:27.178471 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:27.178440 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-cxtqr-269jx" Nov 04 06:10:27.178868 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:27.178437 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-cxtqr-269jx" event={"ID":"50034b21-7861-46ed-81eb-c71bdf4ffeea","Type":"ContainerDied","Data":"701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c"} Nov 04 06:10:27.178868 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:27.178598 4932 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="701aa367c23f206cee6a1ab80346ad952376dc091180ca33f50fd59f4812e94c" Nov 04 06:10:33.535161 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.535125 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:10:33.535583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.535419 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" containerID="cri-o://939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8" gracePeriod=30 Nov 04 06:10:33.558287 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.558250 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:10:33.558493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.558469 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" containerID="cri-o://36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5" gracePeriod=30 Nov 04 06:10:33.581283 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.581254 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:10:33.581475 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.581454 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" containerID="cri-o://7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10" gracePeriod=30 Nov 04 06:10:33.586357 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.586334 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:10:33.586513 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:33.586494 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" containerID="cri-o://50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9" gracePeriod=30 Nov 04 06:10:34.785236 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:34.785197 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:10:34.785614 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:34.785268 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:10:36.134230 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:36.134193 4932 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:10:36.134605 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:36.134270 4932 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:10:38.862896 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.862865 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:10:38.899913 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.899886 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:10:38.928655 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.928631 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:10:38.933710 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.933692 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:10:38.992702 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992680 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.992847 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992717 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.992847 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992754 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.992847 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992790 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.992847 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992827 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992877 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992912 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992941 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.992991 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993005 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.993064 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993039 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993073 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993100 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993138 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993170 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993209 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993223 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993261 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993305 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993353 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993342 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993370 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993397 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993428 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993433 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993461 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993499 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993523 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993561 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993611 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993640 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993692 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993740 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993771 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.993828 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993812 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993849 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993878 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\") pod \"229772c4-ad84-46b6-ab9a-b72520858ae9\" (UID: \"229772c4-ad84-46b6-ab9a-b72520858ae9\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993912 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993950 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\") pod \"f69a51f0-0660-4b34-ba73-6de055a65bd1\" (UID: \"f69a51f0-0660-4b34-ba73-6de055a65bd1\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.993978 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\") pod \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\" (UID: \"3336d0e3-a277-48aa-afc7-88d4f1b16aa9\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994006 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\") pod \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\" (UID: \"ca435b0f-68ae-49f9-a6d9-70a264c2eeed\") " Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994321 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994528 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994553 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.994583 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994572 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.995107 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994588 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.995107 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.994604 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.995363 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.995573 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.995617 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.995714 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.995980 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996302 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.996153 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.996393 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.996689 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.996599 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.997158 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.997128 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.997493 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.997452 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.997743 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.997646 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.997743 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.997696 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.998001 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.997964 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.998203 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.998175 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.998308 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.998259 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.998574 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.998553 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.998658 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.998629 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "kube-api-access-kfc48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:38.999003 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.998969 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.999086 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.999006 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.999166 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:38.999135 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:39.000603 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000573 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:39.000709 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000603 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "kube-api-access-xkq22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.000709 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000649 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "kube-api-access-xh4lw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.000844 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000707 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:39.000844 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000802 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:39.000957 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000904 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.001014 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.000977 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.001014 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.001007 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo" pod "ca435b0f-68ae-49f9-a6d9-70a264c2eeed" (UID: "ca435b0f-68ae-49f9-a6d9-70a264c2eeed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:39.001294 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.001267 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token" pod "3336d0e3-a277-48aa-afc7-88d4f1b16aa9" (UID: "3336d0e3-a277-48aa-afc7-88d4f1b16aa9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.001618 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.001598 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token" pod "229772c4-ad84-46b6-ab9a-b72520858ae9" (UID: "229772c4-ad84-46b6-ab9a-b72520858ae9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.002150 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.002131 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl" pod "f69a51f0-0660-4b34-ba73-6de055a65bd1" (UID: "f69a51f0-0660-4b34-ba73-6de055a65bd1"). InnerVolumeSpecName "kube-api-access-vxqpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095672 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095700 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095710 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69a51f0-0660-4b34-ba73-6de055a65bd1-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095718 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095742 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkq22\" (UniqueName: \"kubernetes.io/projected/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-kube-api-access-xkq22\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095752 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.095757 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095760 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095769 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxqpl\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-kube-api-access-vxqpl\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095777 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095787 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfc48\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-kube-api-access-kfc48\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095796 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh4lw\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-kube-api-access-xh4lw\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095805 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095813 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095821 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095829 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095838 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095846 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095855 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095863 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095871 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095879 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095886 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095894 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095902 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095911 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3336d0e3-a277-48aa-afc7-88d4f1b16aa9-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095921 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca435b0f-68ae-49f9-a6d9-70a264c2eeed-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095929 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69a51f0-0660-4b34-ba73-6de055a65bd1-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095937 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095944 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095953 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229772c4-ad84-46b6-ab9a-b72520858ae9-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.096081 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.095961 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229772c4-ad84-46b6-ab9a-b72520858ae9-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.265517 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.265474 4932 generic.go:356] "Generic (PLEG): container finished" podID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerID="7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10" exitCode=0 Nov 04 06:10:39.265517 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.265517 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" Nov 04 06:10:39.265775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.265553 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" event={"ID":"229772c4-ad84-46b6-ab9a-b72520858ae9","Type":"ContainerDied","Data":"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10"} Nov 04 06:10:39.265775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.265607 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk" event={"ID":"229772c4-ad84-46b6-ab9a-b72520858ae9","Type":"ContainerDied","Data":"6110e6c8985a71af2263ed19f80c24ae2a1e8a44ecda933840e962b32846ac7d"} Nov 04 06:10:39.265775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.265626 4932 scope.go:122] "RemoveContainer" containerID="7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10" Nov 04 06:10:39.267404 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.267376 4932 generic.go:356] "Generic (PLEG): container finished" podID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerID="939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8" exitCode=0 Nov 04 06:10:39.267548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.267527 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" event={"ID":"f69a51f0-0660-4b34-ba73-6de055a65bd1","Type":"ContainerDied","Data":"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8"} Nov 04 06:10:39.267624 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.267580 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" event={"ID":"f69a51f0-0660-4b34-ba73-6de055a65bd1","Type":"ContainerDied","Data":"c071cb8a1ea94e938a7d3baf780813ea8ed093513a67dde440141ec3d27dfde1"} Nov 04 06:10:39.267685 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.267659 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz" Nov 04 06:10:39.271425 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.271396 4932 generic.go:356] "Generic (PLEG): container finished" podID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerID="50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9" exitCode=0 Nov 04 06:10:39.271554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.271503 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" Nov 04 06:10:39.271620 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.271553 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" event={"ID":"3336d0e3-a277-48aa-afc7-88d4f1b16aa9","Type":"ContainerDied","Data":"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9"} Nov 04 06:10:39.271620 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.271607 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6" event={"ID":"3336d0e3-a277-48aa-afc7-88d4f1b16aa9","Type":"ContainerDied","Data":"f4f3d00c193a350551f9926541a8a05ce038b42ecbd7df8a47f6f671a60f9cda"} Nov 04 06:10:39.281178 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.280999 4932 scope.go:122] "RemoveContainer" containerID="7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10" Nov 04 06:10:39.281244 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.281226 4932 generic.go:356] "Generic (PLEG): container finished" podID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerID="36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5" exitCode=0 Nov 04 06:10:39.281333 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.281319 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerDied","Data":"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5"} Nov 04 06:10:39.281373 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.281354 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" event={"ID":"ca435b0f-68ae-49f9-a6d9-70a264c2eeed","Type":"ContainerDied","Data":"c811d8184d36ab1c30a897e1c0c3534ec5f573ff17eb88519f58effe1dcbc233"} Nov 04 06:10:39.281428 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.281417 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt" Nov 04 06:10:39.281984 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:39.281960 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10\": container with ID starting with 7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10 not found: ID does not exist" containerID="7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10" Nov 04 06:10:39.282051 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.281989 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10"} err="failed to get container status \"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10\": rpc error: code = NotFound desc = could not find container \"7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10\": container with ID starting with 7e6cc7f4e657ce7601fa3dad18f5fd2b622ade373eff0d57f68c9f9b74981c10 not found: ID does not exist" Nov 04 06:10:39.282051 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.282007 4932 scope.go:122] "RemoveContainer" containerID="939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8" Nov 04 06:10:39.291743 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.291707 4932 scope.go:122] "RemoveContainer" containerID="939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8" Nov 04 06:10:39.292015 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:39.291999 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8\": container with ID starting with 939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8 not found: ID does not exist" containerID="939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8" Nov 04 06:10:39.292066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.292022 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8"} err="failed to get container status \"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8\": rpc error: code = NotFound desc = could not find container \"939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8\": container with ID starting with 939532163a2fe7c34b21d4e9c39e4a81a4f33a78f91eadcd64b16ddc464996e8 not found: ID does not exist" Nov 04 06:10:39.292066 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.292038 4932 scope.go:122] "RemoveContainer" containerID="50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9" Nov 04 06:10:39.308427 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.308403 4932 scope.go:122] "RemoveContainer" containerID="50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9" Nov 04 06:10:39.308785 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:39.308756 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9\": container with ID starting with 50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9 not found: ID does not exist" containerID="50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9" Nov 04 06:10:39.308870 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.308797 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9"} err="failed to get container status \"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9\": rpc error: code = NotFound desc = could not find container \"50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9\": container with ID starting with 50d6ded6c62a7d06eebe2d7f2bc0858b2e3db0146e258ab01bc80bc6f06a1be9 not found: ID does not exist" Nov 04 06:10:39.308870 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.308821 4932 scope.go:122] "RemoveContainer" containerID="36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5" Nov 04 06:10:39.317506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.317492 4932 scope.go:122] "RemoveContainer" containerID="6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3" Nov 04 06:10:39.325956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.325937 4932 scope.go:122] "RemoveContainer" containerID="36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5" Nov 04 06:10:39.326216 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:39.326197 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5\": container with ID starting with 36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5 not found: ID does not exist" containerID="36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5" Nov 04 06:10:39.326276 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.326220 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5"} err="failed to get container status \"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5\": rpc error: code = NotFound desc = could not find container \"36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5\": container with ID starting with 36b28fc1820655e86d5e605b32742222dc1de6bb9db45708a637112e3866ddb5 not found: ID does not exist" Nov 04 06:10:39.326276 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.326240 4932 scope.go:122] "RemoveContainer" containerID="6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3" Nov 04 06:10:39.326500 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:39.326483 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3\": container with ID starting with 6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3 not found: ID does not exist" containerID="6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3" Nov 04 06:10:39.326544 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.326506 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3"} err="failed to get container status \"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3\": rpc error: code = NotFound desc = could not find container \"6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3\": container with ID starting with 6a6a2e63bbf2afe5b2489d039dae2993a5d23de1be05f00bdd5765580311fae3 not found: ID does not exist" Nov 04 06:10:39.560471 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.560439 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:10:39.566397 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.566337 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk"] Nov 04 06:10:39.618547 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.618517 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" path="/var/lib/kubelet/pods/229772c4-ad84-46b6-ab9a-b72520858ae9/volumes" Nov 04 06:10:39.684270 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.684237 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:10:39.690037 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.690007 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt"] Nov 04 06:10:39.806461 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.806430 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:10:39.812612 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.812544 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz"] Nov 04 06:10:39.931090 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.931049 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:10:39.935405 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:39.935378 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6"] Nov 04 06:10:41.618140 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:41.618105 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" path="/var/lib/kubelet/pods/3336d0e3-a277-48aa-afc7-88d4f1b16aa9/volumes" Nov 04 06:10:41.618544 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:41.618531 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" path="/var/lib/kubelet/pods/ca435b0f-68ae-49f9-a6d9-70a264c2eeed/volumes" Nov 04 06:10:41.618954 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:41.618940 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" path="/var/lib/kubelet/pods/f69a51f0-0660-4b34-ba73-6de055a65bd1/volumes" Nov 04 06:10:42.952903 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:42.952868 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:42.953278 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:42.953077 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" containerID="cri-o://3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc" gracePeriod=30 Nov 04 06:10:42.966768 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:42.966742 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:10:42.966947 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:42.966912 4932 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" containerID="cri-o://78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0" gracePeriod=30 Nov 04 06:10:47.369442 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:47.369397 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:10:48.216030 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.216006 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:48.252554 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.252531 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:10:48.290078 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290053 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290086 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290111 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290213 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290184 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290389 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290234 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290389 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290275 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290389 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290379 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290407 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290432 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\") pod \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\" (UID: \"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac\") " Nov 04 06:10:48.290548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290461 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.290548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290496 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.290775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290668 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.290835 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290819 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.290889 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290824 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.290889 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290839 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.290889 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290855 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.291047 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.290892 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:48.292267 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.292247 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.292376 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.292289 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:48.292432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.292385 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "kube-api-access-pgr6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.292472 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.292460 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token" pod "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" (UID: "15019fc9-9fcf-4853-bf8d-1dd2dcc30dac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.344673 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.344650 4932 generic.go:356] "Generic (PLEG): container finished" podID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerID="3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc" exitCode=0 Nov 04 06:10:48.344813 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.344699 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" Nov 04 06:10:48.344813 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.344747 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" event={"ID":"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac","Type":"ContainerDied","Data":"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc"} Nov 04 06:10:48.344813 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.344803 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb" event={"ID":"15019fc9-9fcf-4853-bf8d-1dd2dcc30dac","Type":"ContainerDied","Data":"1ed154143650d5829ba3b1da08c9450153045738515878d0f63b64bca3f00a67"} Nov 04 06:10:48.344990 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.344832 4932 scope.go:122] "RemoveContainer" containerID="3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc" Nov 04 06:10:48.346598 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.346580 4932 generic.go:356] "Generic (PLEG): container finished" podID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerID="78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0" exitCode=0 Nov 04 06:10:48.346673 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.346618 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerDied","Data":"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0"} Nov 04 06:10:48.346720 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.346682 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" event={"ID":"490c6bf7-6f3b-41b6-a860-a7ad43c48460","Type":"ContainerDied","Data":"8d48f527210bede6336d3f5d15fbed44b19e8437446c88b92ebf2e169f68e4b4"} Nov 04 06:10:48.346720 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.346625 4932 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h" Nov 04 06:10:48.354937 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.354862 4932 scope.go:122] "RemoveContainer" containerID="3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc" Nov 04 06:10:48.355182 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:48.355162 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc\": container with ID starting with 3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc not found: ID does not exist" containerID="3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc" Nov 04 06:10:48.355261 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.355204 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc"} err="failed to get container status \"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc\": rpc error: code = NotFound desc = could not find container \"3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc\": container with ID starting with 3d1d0aeb5093c79ccbe1b7b9f8ee4c8b251c6ecdd52dfa2bd3952b4d33339dbc not found: ID does not exist" Nov 04 06:10:48.355261 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.355222 4932 scope.go:122] "RemoveContainer" containerID="78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0" Nov 04 06:10:48.363873 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.363855 4932 scope.go:122] "RemoveContainer" containerID="f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626" Nov 04 06:10:48.372049 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.372028 4932 scope.go:122] "RemoveContainer" containerID="78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0" Nov 04 06:10:48.372340 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:48.372309 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0\": container with ID starting with 78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0 not found: ID does not exist" containerID="78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0" Nov 04 06:10:48.372388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.372334 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0"} err="failed to get container status \"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0\": rpc error: code = NotFound desc = could not find container \"78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0\": container with ID starting with 78079acbf301b769a5df40486d9ebad257b2760207d936cb50362f7dd73d23b0 not found: ID does not exist" Nov 04 06:10:48.372388 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.372350 4932 scope.go:122] "RemoveContainer" containerID="f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626" Nov 04 06:10:48.372597 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:10:48.372578 4932 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626\": container with ID starting with f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626 not found: ID does not exist" containerID="f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626" Nov 04 06:10:48.372654 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.372602 4932 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626"} err="failed to get container status \"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626\": rpc error: code = NotFound desc = could not find container \"f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626\": container with ID starting with f2b71aad3c95dbf0e88e1ac0a6f4fcb0ed97816198fd3aa20211552e7502c626 not found: ID does not exist" Nov 04 06:10:48.391401 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391377 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391460 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391479 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391520 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391504 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391536 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391607 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391610 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.391699 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391638 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391701 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391769 4932 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\") pod \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\" (UID: \"490c6bf7-6f3b-41b6-a860-a7ad43c48460\") " Nov 04 06:10:48.391955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391791 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.391955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391811 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.391955 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.391882 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392061 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392081 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392096 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392111 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392118 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392124 4932 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-credential-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392145 4932 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-socket\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392158 4932 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-data\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392167 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgr6j\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-kube-api-access-pgr6j\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392177 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.392221 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.392188 4932 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-workload-certs\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.393775 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.393717 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:48.393887 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.393865 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "kube-api-access-949s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.394051 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.394029 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.394136 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.394067 4932 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token" pod "490c6bf7-6f3b-41b6-a860-a7ad43c48460" (UID: "490c6bf7-6f3b-41b6-a860-a7ad43c48460"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.492917 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.492840 4932 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istiod-ca-cert\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.492917 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.492868 4932 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-podinfo\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.492917 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.492881 4932 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-token\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.492917 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.492893 4932 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490c6bf7-6f3b-41b6-a860-a7ad43c48460-istio-envoy\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.492917 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.492906 4932 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-949s6\" (UniqueName: \"kubernetes.io/projected/490c6bf7-6f3b-41b6-a860-a7ad43c48460-kube-api-access-949s6\") on node \"ip-10-0-133-0.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.517295 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.517264 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:48.525958 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.525930 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb"] Nov 04 06:10:48.778060 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.777944 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:10:48.782014 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:48.781986 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h"] Nov 04 06:10:49.616865 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:49.616824 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" path="/var/lib/kubelet/pods/15019fc9-9fcf-4853-bf8d-1dd2dcc30dac/volumes" Nov 04 06:10:49.617453 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:49.617433 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" path="/var/lib/kubelet/pods/490c6bf7-6f3b-41b6-a860-a7ad43c48460/volumes" Nov 04 06:10:56.654403 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:56.654313 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-c4d85ff99-nc79m_359282ff-2f87-4b3d-b403-6f7340261992/manager/0.log" Nov 04 06:10:57.354148 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:10:57.354118 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-gmr6l_2c160027-80c5-46f8-830d-80cc272365f4/manager/0.log" Nov 04 06:11:00.249194 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:00.249151 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-122919c5-7xh9x_4224441b-a7fe-4636-bcae-cb3b97a6b3f6/revoke-keys/0.log" Nov 04 06:11:00.466246 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:00.466213 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-37c23825-nt88g_8d7f535f-2c5a-4578-8ca1-68637ae0ea4e/revoke-keys/0.log" Nov 04 06:11:00.689976 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:00.689895 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-54752bc5-jckf7_56f57fad-66e0-442f-aa77-79bf2070adb9/revoke-keys/0.log" Nov 04 06:11:00.924744 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:00.924695 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-65c9ad2a-fd5p7_8fe190aa-d3fd-4e38-ada2-a1c09bec5559/revoke-keys/0.log" Nov 04 06:11:01.158682 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:01.158650 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-67cff179-xg4gc_8a8315f1-33d2-40fe-bfda-859a13402885/revoke-keys/0.log" Nov 04 06:11:01.389912 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:01.389877 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6ca4e675-hqfxs_ea84f429-8934-4729-bb89-783d9ab2afde/revoke-keys/0.log" Nov 04 06:11:01.608662 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:01.608620 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9b4dbef1-x4hdl_9cdd6067-2255-4a82-a5dd-a1dfe662e9eb/revoke-keys/0.log" Nov 04 06:11:01.829398 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:01.829367 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9cbd57c5-kr285_2d5730bb-17fa-431f-8a6a-ab06cf46470a/revoke-keys/0.log" Nov 04 06:11:02.061220 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:02.061186 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a112906e-pd7q8_b16b914d-97b6-42b6-a84d-f903aaf2efb3/revoke-keys/0.log" Nov 04 06:11:02.295429 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:02.295398 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-bfca4dba-zqk8z_3fa23432-e998-4bd6-908a-11262c6389e0/revoke-keys/0.log" Nov 04 06:11:02.524502 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:02.524475 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-cd1cb4f0-mclv5_04883008-4d54-4812-93de-7a5f7c672406/revoke-keys/0.log" Nov 04 06:11:02.764809 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:02.764785 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-dd400c80-qhldn_701bdb8c-1d59-43c9-87f9-4d83a0dd425a/revoke-keys/0.log" Nov 04 06:11:02.993593 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:02.993569 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-eba7e196-tlrrr_978cf1c5-9493-4a3d-ad8f-10e9383162b4/revoke-keys/0.log" Nov 04 06:11:03.207488 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:03.207457 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f6f9ca18-vxwwz_f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7/revoke-keys/0.log" Nov 04 06:11:03.435643 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:03.435571 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-g664g_b2f4e006-ab6e-4956-83ef-325c27641566/postgres/0.log" Nov 04 06:11:05.749898 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:05.749870 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbx8x_0130cf42-d37d-4db7-96f4-bf240c95c15c/manager/0.log" Nov 04 06:11:05.991943 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:05.991912 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-km68d_dbb95c0c-0262-48b2-af9b-c61251126c21/manager/0.log" Nov 04 06:11:06.895232 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:06.895199 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-pmbzz_d68d0c43-d9af-48c7-9b2d-08ed36453372/manager/0.log" Nov 04 06:11:07.352470 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:07.352437 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-cfsb5_a6f95f24-4dfa-44ef-a1c3-11c873fae729/manager/0.log" Nov 04 06:11:08.348801 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:08.348756 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf_f59676f7-1a81-4862-b7a0-06b2b84386dd/istio-proxy/0.log" Nov 04 06:11:08.587413 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:08.587377 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-x8ks7_e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465/discovery/0.log" Nov 04 06:11:09.274326 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:09.274295 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-gk4kw_fba58e07-66e9-426e-9069-6f9c0a697906/istio-proxy/0.log" Nov 04 06:11:09.723100 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:09.723065 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv_1b5ad66a-ac17-406c-a5b5-570f78302119/istio-proxy/0.log" Nov 04 06:11:09.956057 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:09.956010 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sdjbp_05adccff-76f7-4fea-be8c-c85db638c6ed/payload-pre-processing/0.log" Nov 04 06:11:10.178526 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:10.178455 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:11:10.414657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:10.414630 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c558747f-x6r92_1074f5dc-50ec-4134-b826-aa6be14d2e1f/router/0.log" Nov 04 06:11:12.353015 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:12.352985 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt_5bce6947-8dcb-43dc-9aa8-b3b2ef87455a/main/0.log" Nov 04 06:11:17.369188 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:11:17.369144 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:11:23.010548 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:23.010516 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-c4d85ff99-nc79m_359282ff-2f87-4b3d-b403-6f7340261992/manager/0.log" Nov 04 06:11:23.565602 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:23.565571 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-gmr6l_2c160027-80c5-46f8-830d-80cc272365f4/manager/0.log" Nov 04 06:11:25.698085 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:25.698057 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-122919c5-7xh9x_4224441b-a7fe-4636-bcae-cb3b97a6b3f6/revoke-keys/0.log" Nov 04 06:11:25.925770 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:25.925718 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-37c23825-nt88g_8d7f535f-2c5a-4578-8ca1-68637ae0ea4e/revoke-keys/0.log" Nov 04 06:11:26.151155 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:26.151129 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-54752bc5-jckf7_56f57fad-66e0-442f-aa77-79bf2070adb9/revoke-keys/0.log" Nov 04 06:11:26.378588 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:26.378557 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-65c9ad2a-fd5p7_8fe190aa-d3fd-4e38-ada2-a1c09bec5559/revoke-keys/0.log" Nov 04 06:11:26.591772 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:26.591743 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-67cff179-xg4gc_8a8315f1-33d2-40fe-bfda-859a13402885/revoke-keys/0.log" Nov 04 06:11:26.796178 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:26.796154 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6ca4e675-hqfxs_ea84f429-8934-4729-bb89-783d9ab2afde/revoke-keys/0.log" Nov 04 06:11:27.017215 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:27.017185 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9b4dbef1-x4hdl_9cdd6067-2255-4a82-a5dd-a1dfe662e9eb/revoke-keys/0.log" Nov 04 06:11:27.250347 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:27.250319 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9cbd57c5-kr285_2d5730bb-17fa-431f-8a6a-ab06cf46470a/revoke-keys/0.log" Nov 04 06:11:27.476417 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:27.476389 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a112906e-pd7q8_b16b914d-97b6-42b6-a84d-f903aaf2efb3/revoke-keys/0.log" Nov 04 06:11:27.696815 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:27.696785 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-bfca4dba-zqk8z_3fa23432-e998-4bd6-908a-11262c6389e0/revoke-keys/0.log" Nov 04 06:11:27.926176 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:27.926099 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-cd1cb4f0-mclv5_04883008-4d54-4812-93de-7a5f7c672406/revoke-keys/0.log" Nov 04 06:11:28.148755 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:28.148713 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-dd400c80-qhldn_701bdb8c-1d59-43c9-87f9-4d83a0dd425a/revoke-keys/0.log" Nov 04 06:11:28.365187 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:28.365153 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-eba7e196-tlrrr_978cf1c5-9493-4a3d-ad8f-10e9383162b4/revoke-keys/0.log" Nov 04 06:11:28.591383 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:28.591356 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f6f9ca18-vxwwz_f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7/revoke-keys/0.log" Nov 04 06:11:28.807164 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:28.807133 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-g664g_b2f4e006-ab6e-4956-83ef-325c27641566/postgres/0.log" Nov 04 06:11:30.194532 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:30.194493 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbx8x_0130cf42-d37d-4db7-96f4-bf240c95c15c/manager/0.log" Nov 04 06:11:30.428942 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:30.428909 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-km68d_dbb95c0c-0262-48b2-af9b-c61251126c21/manager/0.log" Nov 04 06:11:30.913692 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:30.913665 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-pmbzz_d68d0c43-d9af-48c7-9b2d-08ed36453372/manager/0.log" Nov 04 06:11:31.479224 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:31.479191 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-cfsb5_a6f95f24-4dfa-44ef-a1c3-11c873fae729/manager/0.log" Nov 04 06:11:32.044155 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:32.044125 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf_f59676f7-1a81-4862-b7a0-06b2b84386dd/istio-proxy/0.log" Nov 04 06:11:32.274220 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:32.274192 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-x8ks7_e7bc0e2d-9d48-4ad2-b0f0-ea0f30569465/discovery/0.log" Nov 04 06:11:32.953876 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:32.953843 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-gk4kw_fba58e07-66e9-426e-9069-6f9c0a697906/istio-proxy/0.log" Nov 04 06:11:33.429739 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:33.429706 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv_1b5ad66a-ac17-406c-a5b5-570f78302119/istio-proxy/0.log" Nov 04 06:11:33.650485 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:33.650457 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sdjbp_05adccff-76f7-4fea-be8c-c85db638c6ed/payload-pre-processing/0.log" Nov 04 06:11:33.883878 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:33.883853 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:11:34.116470 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:34.116444 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c558747f-x6r92_1074f5dc-50ec-4134-b826-aa6be14d2e1f/router/0.log" Nov 04 06:11:35.582668 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:35.582639 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qr9wt_5bce6947-8dcb-43dc-9aa8-b3b2ef87455a/main/0.log" Nov 04 06:11:47.369107 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:11:47.369071 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:11:59.614101 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:59.614065 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:11:59.846111 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:11:59.846082 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:12:17.369357 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:12:17.369320 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:12:31.182473 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:31.182438 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:12:31.400657 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:31.400627 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-246k6_9ab123bb-9978-4465-9ecc-d6ac6b646040/payload-processing/0.log" Nov 04 06:12:41.059924 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:41.059890 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285"] Nov 04 06:12:41.113181 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:41.113145 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cbd57c5-kr285"] Nov 04 06:12:41.618067 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:41.618033 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d5730bb-17fa-431f-8a6a-ab06cf46470a" path="/var/lib/kubelet/pods/2d5730bb-17fa-431f-8a6a-ab06cf46470a/volumes" Nov 04 06:12:42.049758 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:42.049708 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7"] Nov 04 06:12:42.103192 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:42.103161 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-65c9ad2a-fd5p7"] Nov 04 06:12:42.279527 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:42.279495 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xpsrx_476606ea-919f-4515-9203-8b2037dc7c51/global-pull-secret-syncer/0.log" Nov 04 06:12:42.912364 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:42.912341 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-gkpc2_3ab95ff4-c0b4-4739-8727-3cae87d8b87b/connection-checker/0.log" Nov 04 06:12:43.361010 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:43.360984 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-ktphf_c71ff75b-812f-45b8-9d99-58324eea7954/connection-checker/0.log" Nov 04 06:12:43.617375 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:43.617291 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fe190aa-d3fd-4e38-ada2-a1c09bec5559" path="/var/lib/kubelet/pods/8fe190aa-d3fd-4e38-ada2-a1c09bec5559/volumes" Nov 04 06:12:43.809237 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:43.809210 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-n7dfn_528189d9-79b8-4ab9-82b0-88108f123fbd/connection-checker/0.log" Nov 04 06:12:45.049184 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:45.049145 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz"] Nov 04 06:12:45.102506 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:45.102476 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f6f9ca18-vxwwz"] Nov 04 06:12:45.180212 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:45.180183 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swhsx_7a037747-8bc9-4521-bf55-cc2bfabbf819/konnectivity-agent/0.log" Nov 04 06:12:45.614886 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:45.614847 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-0.us-west-1.compute.internal_f094e9921d2f7c68bdccfd2d0136c26f/haproxy/0.log" Nov 04 06:12:45.617850 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:45.617826 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7" path="/var/lib/kubelet/pods/f0d47996-5f12-4a43-9ad0-ce57d9f2e8c7/volumes" Nov 04 06:12:47.051956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:47.051914 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn"] Nov 04 06:12:47.101869 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:47.101839 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dd400c80-qhldn"] Nov 04 06:12:47.369092 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:12:47.369005 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor" Nov 04 06:12:47.616899 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:47.616859 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="701bdb8c-1d59-43c9-87f9-4d83a0dd425a" path="/var/lib/kubelet/pods/701bdb8c-1d59-43c9-87f9-4d83a0dd425a/volumes" Nov 04 06:12:58.048820 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:58.048783 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7"] Nov 04 06:12:58.102046 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:58.102019 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-54752bc5-jckf7"] Nov 04 06:12:59.048992 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:59.048960 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs"] Nov 04 06:12:59.102469 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:59.102439 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6ca4e675-hqfxs"] Nov 04 06:12:59.617620 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:59.617586 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56f57fad-66e0-442f-aa77-79bf2070adb9" path="/var/lib/kubelet/pods/56f57fad-66e0-442f-aa77-79bf2070adb9/volumes" Nov 04 06:12:59.618041 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:12:59.618026 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea84f429-8934-4729-bb89-783d9ab2afde" path="/var/lib/kubelet/pods/ea84f429-8934-4729-bb89-783d9ab2afde/volumes" Nov 04 06:13:00.049956 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:00.049922 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc"] Nov 04 06:13:00.105201 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:00.105164 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-67cff179-xg4gc"] Nov 04 06:13:00.495669 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:00.495644 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbx8x_0130cf42-d37d-4db7-96f4-bf240c95c15c/manager/0.log" Nov 04 06:13:00.943862 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:00.943792 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-km68d_dbb95c0c-0262-48b2-af9b-c61251126c21/manager/0.log" Nov 04 06:13:01.617867 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:01.617835 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a8315f1-33d2-40fe-bfda-859a13402885" path="/var/lib/kubelet/pods/8a8315f1-33d2-40fe-bfda-859a13402885/volumes" Nov 04 06:13:02.054791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:02.054760 4932 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8"] Nov 04 06:13:02.093463 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:02.093423 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-pmbzz_d68d0c43-d9af-48c7-9b2d-08ed36453372/manager/0.log" Nov 04 06:13:02.108248 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:02.108220 4932 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a112906e-pd7q8"] Nov 04 06:13:02.893349 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:02.893317 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-cfsb5_a6f95f24-4dfa-44ef-a1c3-11c873fae729/manager/0.log" Nov 04 06:13:03.616587 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.616553 4932 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b16b914d-97b6-42b6-a84d-f903aaf2efb3" path="/var/lib/kubelet/pods/b16b914d-97b6-42b6-a84d-f903aaf2efb3/volumes" Nov 04 06:13:03.698190 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698156 4932 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs"] Nov 04 06:13:03.698576 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698564 4932 cpu_manager.go:414] "containerMap: removing container" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" Nov 04 06:13:03.698619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698578 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" Nov 04 06:13:03.698619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698594 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.698619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698600 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.698619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698610 4932 cpu_manager.go:414] "containerMap: removing container" podUID="50034b21-7861-46ed-81eb-c71bdf4ffeea" containerName="insights-gathering" Nov 04 06:13:03.698619 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698615 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50034b21-7861-46ed-81eb-c71bdf4ffeea" containerName="insights-gathering" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698623 4932 cpu_manager.go:414] "containerMap: removing container" podUID="d04e9516-c1bb-4645-8730-12a1bffa593d" containerName="payload-pre-processing" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698628 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d04e9516-c1bb-4645-8730-12a1bffa593d" containerName="payload-pre-processing" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698639 4932 cpu_manager.go:414] "containerMap: removing container" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698643 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698651 4932 cpu_manager.go:414] "containerMap: removing container" podUID="04883008-4d54-4812-93de-7a5f7c672406" containerName="revoke-keys" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698656 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04883008-4d54-4812-93de-7a5f7c672406" containerName="revoke-keys" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698662 4932 cpu_manager.go:414] "containerMap: removing container" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698666 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698681 4932 cpu_manager.go:414] "containerMap: removing container" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698685 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698692 4932 cpu_manager.go:414] "containerMap: removing container" podUID="64c88e0a-7571-40ce-abce-97dec74c05a3" containerName="payload-processing" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698696 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c88e0a-7571-40ce-abce-97dec74c05a3" containerName="payload-processing" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698702 4932 cpu_manager.go:414] "containerMap: removing container" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698706 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698712 4932 cpu_manager.go:414] "containerMap: removing container" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698717 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698737 4932 cpu_manager.go:414] "containerMap: removing container" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698741 4932 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.698811 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698813 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="229772c4-ad84-46b6-ab9a-b72520858ae9" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698822 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="04883008-4d54-4812-93de-7a5f7c672406" containerName="revoke-keys" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698833 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="3336d0e3-a277-48aa-afc7-88d4f1b16aa9" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698839 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698845 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="f69a51f0-0660-4b34-ba73-6de055a65bd1" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698850 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c88e0a-7571-40ce-abce-97dec74c05a3" containerName="payload-processing" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698854 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca435b0f-68ae-49f9-a6d9-70a264c2eeed" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698860 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="15019fc9-9fcf-4853-bf8d-1dd2dcc30dac" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698864 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="50034b21-7861-46ed-81eb-c71bdf4ffeea" containerName="insights-gathering" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698869 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698875 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="d04e9516-c1bb-4645-8730-12a1bffa593d" containerName="payload-pre-processing" Nov 04 06:13:03.699432 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.698880 4932 memory_manager.go:365] "RemoveStaleState removing state" podUID="490c6bf7-6f3b-41b6-a860-a7ad43c48460" containerName="istio-proxy" Nov 04 06:13:03.702247 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.702231 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.761603 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.761574 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs"] Nov 04 06:13:03.788827 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.788762 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/22b69245-010b-483e-9d6f-65a29364622c-kube-api-access-v4xqj\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.788969 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.788851 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-sys\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.788969 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.788874 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-lib-modules\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.789048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.788974 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-podres\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.789048 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.789005 4932 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-proc\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.812074 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.812051 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"openshift-service-ca.crt\"" Nov 04 06:13:03.812185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.812076 4932 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntc6w\"/\"default-dockercfg-pqhfh\"" Nov 04 06:13:03.812185 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.812149 4932 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"kube-root-ca.crt\"" Nov 04 06:13:03.889498 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889423 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-sys\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889498 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889460 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-lib-modules\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889513 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-podres\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889532 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-proc\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889547 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-sys\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889563 4932 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/22b69245-010b-483e-9d6f-65a29364622c-kube-api-access-v4xqj\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889621 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-lib-modules\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889627 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-proc\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.889704 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.889629 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22b69245-010b-483e-9d6f-65a29364622c-podres\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:03.954569 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:03.954543 4932 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/22b69245-010b-483e-9d6f-65a29364622c-kube-api-access-v4xqj\") pod \"perf-node-gather-daemonset-vzwgs\" (UID: \"22b69245-010b-483e-9d6f-65a29364622c\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:04.013678 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:04.013649 4932 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:04.400765 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:04.400713 4932 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs"] Nov 04 06:13:04.401461 ip-10-0-133-0 kubenswrapper[4932]: W1104 06:13:04.401435 4932 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod22b69245_010b_483e_9d6f_65a29364622c.slice/crio-2781c7804638a3776997d0bac43a7e7d6981f4fc8b3e676ac3622d8716ed206a WatchSource:0}: Error finding container 2781c7804638a3776997d0bac43a7e7d6981f4fc8b3e676ac3622d8716ed206a: Status 404 returned error can't find the container with id 2781c7804638a3776997d0bac43a7e7d6981f4fc8b3e676ac3622d8716ed206a Nov 04 06:13:05.198791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:05.198681 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" event={"ID":"22b69245-010b-483e-9d6f-65a29364622c","Type":"ContainerStarted","Data":"a5c45e1298da7e5bfcbd1cf8f5b22d4ef9c99232863785a2c9b87da844181275"} Nov 04 06:13:05.198791 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:05.198763 4932 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" event={"ID":"22b69245-010b-483e-9d6f-65a29364622c","Type":"ContainerStarted","Data":"2781c7804638a3776997d0bac43a7e7d6981f4fc8b3e676ac3622d8716ed206a"} Nov 04 06:13:05.199202 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:05.198794 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:05.322416 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:05.322364 4932 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" podStartSLOduration=2.32235073 podStartE2EDuration="2.32235073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 06:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:13:05.320637305 +0000 UTC m=+1433.818032063" watchObservedRunningTime="2026-11-04 06:13:05.32235073 +0000 UTC m=+1433.819745494" Nov 04 06:13:08.816656 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:08.816625 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-g9clx_95de3b39-ddde-46a0-aef0-47358e3b8c5a/cluster-monitoring-operator/0.log" Nov 04 06:13:11.214534 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:11.214510 4932 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vzwgs" Nov 04 06:13:11.488742 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:11.488699 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chb6k_a973f739-6351-4614-8170-d01928fdb59c/node-exporter/0.log" Nov 04 06:13:11.931988 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:11.931916 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chb6k_a973f739-6351-4614-8170-d01928fdb59c/kube-rbac-proxy/0.log" Nov 04 06:13:12.378378 ip-10-0-133-0 kubenswrapper[4932]: I1104 06:13:12.378349 4932 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-chb6k_a973f739-6351-4614-8170-d01928fdb59c/init-textfile/0.log" Nov 04 06:13:17.369867 ip-10-0-133-0 kubenswrapper[4932]: E1104 06:13:17.369831 4932 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pthc4" containerName="extractor"