Nov 03 17:28:46.832877 ip-10-0-141-130 systemd[1]: Starting Kubernetes Kubelet... Nov 03 17:28:47.242918 ip-10-0-141-130 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:28:47.242918 ip-10-0-141-130 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 17:28:47.242918 ip-10-0-141-130 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:28:47.242918 ip-10-0-141-130 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:28:47.246626 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246527 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.246626 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246625 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.246626 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246629 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246632 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246637 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246640 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246645 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246649 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246652 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246655 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246657 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246660 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246663 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246666 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246668 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246671 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246674 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246684 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246687 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246690 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246692 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.246720 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246695 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246697 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246701 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246703 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246706 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246709 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246711 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246714 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246717 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246719 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246722 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246725 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246728 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246731 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246734 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246737 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246740 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246742 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246745 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.247173 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246747 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246750 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246752 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246755 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246757 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246760 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246762 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246765 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246768 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246771 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246774 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246776 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246779 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246781 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246784 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246787 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246789 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246792 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246795 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.247784 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246797 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246800 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246803 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246806 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246809 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246811 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246814 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246816 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246819 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246822 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246824 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246827 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246829 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246832 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246839 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246843 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246847 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246850 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246853 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.248249 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246855 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246858 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246861 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246864 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246867 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246870 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246872 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246875 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246880 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246882 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246885 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246888 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246890 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246893 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246896 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246898 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246901 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246903 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246906 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246909 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.248721 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246911 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246914 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246916 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246919 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246921 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246924 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246926 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.249216 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.246929 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249217 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249227 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249231 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249234 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249237 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249239 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249242 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249245 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249248 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249251 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249253 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249257 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249259 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249262 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249264 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249267 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249270 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249272 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.249382 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249275 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249277 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249280 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249283 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249285 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249288 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249290 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249293 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249295 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249298 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249301 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249303 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249306 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249308 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249311 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249314 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249317 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249320 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249322 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249325 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.249894 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249327 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249330 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249332 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249335 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249338 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249340 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249343 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249345 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249348 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249350 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249353 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249355 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249358 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249360 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249363 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249371 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249374 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249377 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249379 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249382 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.250371 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249385 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249387 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249390 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249392 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249395 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249398 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249400 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249404 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249408 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249412 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249415 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249418 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249420 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249423 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249425 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249428 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249431 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249433 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249436 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.250923 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249439 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249442 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249444 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249447 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249449 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249452 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249454 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249457 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249459 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249462 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249464 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249467 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249469 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249472 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249475 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249477 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249480 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249484 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249489 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249492 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.251383 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249496 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249499 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249502 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249504 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249507 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249509 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249512 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249514 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.249517 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250081 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250088 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250092 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250095 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250098 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250101 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250103 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250106 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250109 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250111 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.251868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250114 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250117 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250120 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250122 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250125 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250128 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250130 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250133 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250136 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250138 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250141 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250143 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250146 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250149 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250151 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250154 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250157 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250159 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250162 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.252324 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250165 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250167 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250170 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250172 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250175 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250178 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250181 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250183 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250186 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250188 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250191 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250194 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250196 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250199 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250201 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250204 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250206 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250209 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250212 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250215 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.252780 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250219 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250222 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250225 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250228 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250230 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250233 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250236 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250239 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250241 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250244 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250246 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250249 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250251 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250254 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250257 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250259 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250262 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250264 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250267 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250270 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.253347 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250273 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250275 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250278 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250280 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250283 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250285 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250288 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250290 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250292 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250297 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250299 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250302 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250304 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250307 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250310 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250313 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250315 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250318 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250320 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250323 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.253847 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250326 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250328 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250331 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250335 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250338 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250341 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250344 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250347 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250350 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250352 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250355 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250359 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250361 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250364 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250367 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250369 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.250374 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251338 2576 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251353 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251360 2576 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 17:28:47.254303 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251365 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251371 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251374 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251381 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251390 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251394 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251397 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251401 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251404 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251407 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251410 2576 flags.go:64] FLAG: --cgroup-root="" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251413 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251416 2576 flags.go:64] FLAG: --client-ca-file="" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251419 2576 flags.go:64] FLAG: --cloud-provider="external" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251422 2576 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251427 2576 flags.go:64] FLAG: --cluster-domain="" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251430 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251433 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251436 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251440 2576 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251444 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251447 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251451 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 17:28:47.254779 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251454 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251458 2576 flags.go:64] FLAG: --contention-profiling="false" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251461 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251465 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251468 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251471 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251475 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251478 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251481 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251484 2576 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251487 2576 flags.go:64] FLAG: --enable-server="true" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251490 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251496 2576 flags.go:64] FLAG: --event-burst="100" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251499 2576 flags.go:64] FLAG: --event-qps="50" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251502 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251505 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251508 2576 flags.go:64] FLAG: --eviction-hard="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251513 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251516 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251519 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251522 2576 flags.go:64] FLAG: --eviction-soft="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251525 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251528 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251531 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251534 2576 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 17:28:47.255309 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251537 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251540 2576 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251543 2576 flags.go:64] FLAG: --feature-gates="" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251547 2576 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251550 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251554 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251557 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251560 2576 flags.go:64] FLAG: --healthz-port="10248" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251573 2576 flags.go:64] FLAG: --help="false" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251578 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251581 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251584 2576 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251587 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251591 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251594 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251597 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251600 2576 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251604 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251606 2576 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251610 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251613 2576 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251616 2576 flags.go:64] FLAG: --kube-reserved="" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251619 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251623 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 17:28:47.255986 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251626 2576 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251629 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251632 2576 flags.go:64] FLAG: --lock-file="" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251635 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251637 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251640 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251646 2576 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251649 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251652 2576 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251654 2576 flags.go:64] FLAG: --logging-format="text" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251657 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251661 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251664 2576 flags.go:64] FLAG: --manifest-url="" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251667 2576 flags.go:64] FLAG: --manifest-url-header="" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251671 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251674 2576 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251678 2576 flags.go:64] FLAG: --max-pods="110" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251682 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251685 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251688 2576 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251691 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251694 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251697 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251700 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251707 2576 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 17:28:47.256552 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251710 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251713 2576 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251716 2576 flags.go:64] FLAG: --pod-cidr="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251719 2576 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251722 2576 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251725 2576 flags.go:64] FLAG: --pods-per-core="0" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251728 2576 flags.go:64] FLAG: --port="10250" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251731 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251734 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0336a7053491bb522" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251738 2576 flags.go:64] FLAG: --qos-reserved="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251741 2576 flags.go:64] FLAG: --read-only-port="10255" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251744 2576 flags.go:64] FLAG: --register-node="true" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251746 2576 flags.go:64] FLAG: --register-with-taints="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251750 2576 flags.go:64] FLAG: --registry-burst="10" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251753 2576 flags.go:64] FLAG: --registry-qps="5" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251756 2576 flags.go:64] FLAG: --reserved-cpus="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251759 2576 flags.go:64] FLAG: --reserved-memory="" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251763 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251766 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251769 2576 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251772 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251775 2576 flags.go:64] FLAG: --runonce="false" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251777 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251781 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251784 2576 flags.go:64] FLAG: --seccomp-default="false" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251787 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251791 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 17:28:47.257141 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251794 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251798 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251801 2576 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251804 2576 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251807 2576 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251810 2576 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251812 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251816 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251819 2576 flags.go:64] FLAG: --system-cgroups="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251822 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251827 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251830 2576 flags.go:64] FLAG: --tls-cert-file="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251833 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251837 2576 flags.go:64] FLAG: --tls-min-version="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251840 2576 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251843 2576 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251846 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251849 2576 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251852 2576 flags.go:64] FLAG: --v="2" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251856 2576 flags.go:64] FLAG: --version="false" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251860 2576 flags.go:64] FLAG: --vmodule="" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251865 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.251868 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252013 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.258349 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252018 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252021 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252023 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252027 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252033 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252036 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252040 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252043 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252046 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252049 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252052 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252056 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252059 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252061 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252064 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252067 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252070 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252072 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252075 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.259087 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252077 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252080 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252082 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252085 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252088 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252090 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252093 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252095 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252098 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252100 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252103 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252106 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252108 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252111 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252113 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252116 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252119 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252122 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252125 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.259826 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252128 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252130 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252133 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252136 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252139 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252143 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252146 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252148 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252151 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252154 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252156 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252159 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252161 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252164 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252167 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252169 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252172 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252175 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252177 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252180 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.260298 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252182 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252185 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252188 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252190 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252193 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252195 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252198 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252200 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252203 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252206 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252209 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252212 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252215 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252217 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252220 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252222 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252229 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252233 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252236 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252238 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.260828 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252241 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252243 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252246 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252248 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252251 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252253 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252256 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252259 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252261 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252264 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252266 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252269 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252272 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252274 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252277 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252280 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252282 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252285 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252287 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.261288 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252291 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252295 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252299 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252303 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252306 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252309 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252311 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252314 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.252342 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252384 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252389 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252394 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252397 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252399 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252402 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252405 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.261817 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252408 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252410 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252413 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252415 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252418 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252420 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252423 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252425 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252428 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252430 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252433 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252436 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252439 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252441 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252444 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252446 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252449 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252451 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252454 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252458 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.262209 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252460 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252463 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252465 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252468 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252470 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252473 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252475 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252480 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252483 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252485 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252488 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252490 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252493 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252496 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252498 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252501 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252503 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252506 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252508 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252511 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.262679 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252513 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252516 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252518 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252521 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252524 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252526 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252529 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252531 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252534 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252537 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252540 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252543 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252546 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252549 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252551 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252554 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252556 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252560 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252575 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.263150 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252580 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252583 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252586 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252589 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252591 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252594 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252596 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252599 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252601 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252604 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252608 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252611 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252614 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252617 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252619 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252622 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252624 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252627 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252629 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.263615 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252632 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252635 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252637 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252639 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252642 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252646 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252648 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252651 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252653 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252656 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252658 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252661 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252663 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252667 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252670 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252673 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252676 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252678 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252682 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.264071 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252684 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.252687 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.260694 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.260709 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.260725 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.260731 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260790 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260796 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260799 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260802 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260805 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260808 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260811 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260815 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260819 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260822 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260826 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260829 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260833 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.264524 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260836 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260838 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260841 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260844 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260847 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260849 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260852 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260855 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260857 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260860 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260863 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260865 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260869 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260872 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260875 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260878 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260881 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260884 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260887 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.265006 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260890 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260892 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260895 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260898 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260900 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260903 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260906 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260909 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260911 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260914 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260916 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260919 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260921 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260924 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260926 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260929 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260932 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260934 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260937 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260940 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.265454 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260942 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260945 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260948 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260951 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260953 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260957 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260959 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260962 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260965 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260967 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260970 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260974 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260978 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260981 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260984 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260986 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260989 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260992 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.266013 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260995 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.260997 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261000 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261002 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261005 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261007 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261010 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261012 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261015 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261018 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261021 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261024 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261026 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261029 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261031 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261034 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261037 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261040 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261042 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261045 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.266482 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261048 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261050 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261053 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261056 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261058 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261061 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261063 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261066 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261068 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261071 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261074 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261076 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261079 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261081 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261084 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261086 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.267014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.261115 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261257 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261263 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261266 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261270 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261275 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261278 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261281 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261283 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261286 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261289 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261292 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261295 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261298 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261301 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261304 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261306 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261310 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261314 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.267386 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261316 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261319 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261322 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261324 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261327 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261330 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261332 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261335 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261337 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261340 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261342 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261345 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261347 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261350 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261352 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261355 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261358 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261360 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261362 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261365 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.267858 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261368 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261371 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261374 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261376 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261379 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261382 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261385 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261388 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261390 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261393 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261396 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261398 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261401 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261403 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261406 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261408 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261411 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261413 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261416 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261419 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.268379 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261421 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261424 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261426 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261429 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261431 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261434 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261436 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261439 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261441 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261444 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261446 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261449 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261451 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261455 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261458 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261460 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261464 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261466 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261469 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.268868 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261471 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261474 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261476 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261479 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261482 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261484 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261486 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261489 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261491 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261494 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261496 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261499 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261501 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261504 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261506 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261509 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261511 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261514 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261517 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.269326 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261519 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261522 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261524 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261527 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261529 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261532 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261534 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261537 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261540 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261542 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.261582 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261622 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261626 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261629 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261632 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261635 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:28:47.269884 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261638 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261641 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261643 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261646 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261649 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261651 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261654 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261656 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261659 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261662 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261664 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261666 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261669 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261671 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261674 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261677 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261679 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261682 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261684 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261687 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:28:47.270263 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261690 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261692 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261695 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261698 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261700 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261704 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261707 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261709 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261712 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261714 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261717 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261720 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261722 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261726 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261729 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261732 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261735 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261738 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261741 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:28:47.270735 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261743 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261746 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261749 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261751 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261754 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261756 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261759 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261762 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261765 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261768 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261771 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261774 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261777 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261779 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261784 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261787 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261790 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261792 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261795 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:28:47.271177 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261798 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261800 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261803 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261806 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261808 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261810 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261813 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261815 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261818 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261821 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261823 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261826 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261829 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261832 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261835 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261837 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261840 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261843 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261845 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261848 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:28:47.271619 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261851 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261853 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261856 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261859 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261861 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261864 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261866 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261869 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261872 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261875 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261877 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261880 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261882 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261886 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261890 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261892 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261895 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261897 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261899 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:28:47.272091 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261902 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261905 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261907 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:47.261909 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.261964 2576 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.263893 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.264790 2576 server.go:1014] "Starting client certificate rotation" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.264883 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.264912 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.266599 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 17:28:47.272537 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.269156 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 17:28:47.279283 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.279270 2576 log.go:25] "Validated CRI v1 runtime API" Nov 03 17:28:47.282887 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.282868 2576 log.go:25] "Validated CRI v1 image API" Nov 03 17:28:47.283752 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.283726 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 17:28:47.286555 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.286527 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c6dcacae-b588-48ab-aa8f-75e95ae8a6fc:/dev/nvme0n1p3 f7b42f30-e13e-4666-a3fc-48351d55ddb9:/dev/nvme0n1p4] Nov 03 17:28:47.286640 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.286555 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 17:28:47.292530 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.292400 2576 manager.go:217] Machine: {Timestamp:2026-11-03 17:28:47.291066468 +0000 UTC m=+0.330484248 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100012 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b88d1ec64655a4cf1898e7e1997e6 SystemUUID:ec2b88d1-ec64-655a-4cf1-898e7e1997e6 BootID:0df82f01-aa38-4ab0-bfa5-fd993cf51fba Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c2:d7:63:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c2:d7:63:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:ff:93:d1:87:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 17:28:47.292530 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.292521 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 17:28:47.292711 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.292659 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 17:28:47.295359 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295334 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 17:28:47.295493 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295360 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-130.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 17:28:47.295545 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295496 2576 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 17:28:47.295545 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295505 2576 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 17:28:47.295545 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295531 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 17:28:47.295640 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.295545 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 17:28:47.296415 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.296404 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 17:28:47.300187 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.300173 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 17:28:47.300312 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.300303 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 17:28:47.301010 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.301000 2576 kubelet.go:493] "Attempting to sync node with API server" Nov 03 17:28:47.301050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.301014 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 17:28:47.301050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.301024 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 17:28:47.301050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.301034 2576 kubelet.go:405] "Adding apiserver pod source" Nov 03 17:28:47.301050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.301043 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 17:28:47.303312 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.302840 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 17:28:47.306123 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.306101 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 17:28:47.311148 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.311130 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 17:28:47.312176 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312153 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 17:28:47.312252 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312186 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 17:28:47.312350 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312339 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 17:28:47.312389 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312355 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 17:28:47.312389 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312362 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 17:28:47.312389 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312367 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 17:28:47.312389 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312372 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 17:28:47.312389 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312378 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 17:28:47.312907 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312895 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 17:28:47.312907 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312907 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 17:28:47.312983 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312916 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 17:28:47.312983 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312922 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 17:28:47.312983 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312931 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 17:28:47.312983 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.312940 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 17:28:47.313492 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.313483 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 17:28:47.313492 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.313492 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 17:28:47.317845 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.317827 2576 server.go:1263] "Started kubelet" Nov 03 17:28:47.317972 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.317943 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 17:28:47.318110 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.318043 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 17:28:47.318194 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.318129 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 17:28:47.318690 ip-10-0-141-130 systemd[1]: Started Kubernetes Kubelet. Nov 03 17:28:47.319254 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.319237 2576 server.go:317] "Adding debug handlers to kubelet server" Nov 03 17:28:47.319478 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.319458 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 17:28:47.323004 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.322983 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 17:28:47.324789 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.324764 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 17:28:47.325632 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.325604 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 17:28:47.326347 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.326014 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.326442 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326369 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 17:28:47.326442 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326396 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 17:28:47.326442 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326411 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 17:28:47.326612 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326486 2576 factory.go:55] Registering systemd factory Nov 03 17:28:47.326612 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326502 2576 factory.go:223] Registration of the systemd container factory successfully Nov 03 17:28:47.326612 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326529 2576 reconstruct.go:97] "Volume reconstruction finished" Nov 03 17:28:47.326612 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326536 2576 reconciler.go:29] "Reconciler: start to sync state" Nov 03 17:28:47.326758 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326691 2576 factory.go:153] Registering CRI-O factory Nov 03 17:28:47.326758 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326700 2576 factory.go:223] Registration of the crio container factory successfully Nov 03 17:28:47.326817 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326779 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 17:28:47.326817 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326794 2576 factory.go:103] Registering Raw factory Nov 03 17:28:47.326817 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.326804 2576 manager.go:1199] Started watching for new ooms in manager Nov 03 17:28:47.327912 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.327884 2576 manager.go:319] Starting recovery of all containers Nov 03 17:28:47.328047 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.328022 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 03 17:28:47.328152 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.328115 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-130.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 03 17:28:47.328152 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.328141 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-130.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 03 17:28:47.328251 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.328218 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-130.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 17:28:47.329414 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.328231 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e4992306d48d38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.3177982 +0000 UTC m=+0.357215981,LastTimestamp:2026-11-03 17:28:47.3177982 +0000 UTC m=+0.357215981,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.329763 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.329735 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 17:28:47.332996 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.332969 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 03 17:28:47.340374 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.340353 2576 manager.go:324] Recovery completed Nov 03 17:28:47.344748 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.344707 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.346614 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.346555 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.346702 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.346668 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.346702 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.346681 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.347261 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.347246 2576 cpu_manager.go:226] "Starting" policy="none" Nov 03 17:28:47.347261 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.347258 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 17:28:47.347391 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.347269 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.347391 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.347276 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 17:28:47.347990 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.347974 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.348050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.348003 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.348050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.348014 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.349141 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.349053 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088cd71d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.346652957 +0000 UTC m=+0.386070738,LastTimestamp:2026-11-03 17:28:47.346652957 +0000 UTC m=+0.386070738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.349646 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.349633 2576 policy_none.go:50] "Start" Nov 03 17:28:47.349715 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.349653 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 17:28:47.349715 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.349667 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 17:28:47.351980 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.351965 2576 policy_none.go:44] "Start" Nov 03 17:28:47.362303 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.362231 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088d2ef0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.34667544 +0000 UTC m=+0.386093222,LastTimestamp:2026-11-03 17:28:47.34667544 +0000 UTC m=+0.386093222,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.367869 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.367783 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088d55cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.346685388 +0000 UTC m=+0.386103170,LastTimestamp:2026-11-03 17:28:47.346685388 +0000 UTC m=+0.386103170,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.375053 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.374967 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-130.us-east-2.compute.internal.18e49923088cd71d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088cd71d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.346652957 +0000 UTC m=+0.386070738,LastTimestamp:2026-11-03 17:28:47.347990136 +0000 UTC m=+0.387407921,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.390512 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.390435 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-130.us-east-2.compute.internal.18e49923088d2ef0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088d2ef0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.34667544 +0000 UTC m=+0.386093222,LastTimestamp:2026-11-03 17:28:47.348007853 +0000 UTC m=+0.387425635,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.391222 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.391194 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 17:28:47.394145 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394117 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8d5p" Nov 03 17:28:47.394297 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394284 2576 manager.go:341] "Starting Device Plugin manager" Nov 03 17:28:47.394408 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.394387 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 17:28:47.394408 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394402 2576 server.go:87] "Starting device plugin registration server" Nov 03 17:28:47.394705 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394692 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 17:28:47.394771 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394705 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 17:28:47.394825 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394809 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 17:28:47.394934 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394921 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 17:28:47.394934 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.394933 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 17:28:47.395487 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.395468 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 17:28:47.395559 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.395524 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.403039 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.402968 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-130.us-east-2.compute.internal.18e49923088d55cc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e49923088d55cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-130.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.346685388 +0000 UTC m=+0.386103170,LastTimestamp:2026-11-03 17:28:47.348018027 +0000 UTC m=+0.387435808,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.406601 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.406584 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8d5p" Nov 03 17:28:47.434668 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.420110 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e499230b633e7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated limits on system reserved cgroup /system.slice,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.394258559 +0000 UTC m=+0.433676331,LastTimestamp:2026-11-03 17:28:47.394258559 +0000 UTC m=+0.433676331,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.434668 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.433704 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.us-east-2.compute.internal.18e499230b8066b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.us-east-2.compute.internal,},FirstTimestamp:2026-11-03 17:28:47.396169394 +0000 UTC m=+0.435587161,LastTimestamp:2026-11-03 17:28:47.396169394 +0000 UTC m=+0.435587161,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.us-east-2.compute.internal,}" Nov 03 17:28:47.462925 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.462888 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 17:28:47.464113 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.464095 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 17:28:47.464113 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.464117 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 17:28:47.464272 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.464136 2576 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 17:28:47.464272 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.464168 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 17:28:47.492792 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.492768 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" Nov 03 17:28:47.494864 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.494801 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.495660 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.495645 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.495734 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.495669 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.495734 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.495680 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.495734 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.495704 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.518325 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.518292 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.518325 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.518325 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-130.us-east-2.compute.internal\": node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.553938 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.553907 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.565007 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.564968 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal"] Nov 03 17:28:47.565100 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.565047 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.566051 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.566032 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.566149 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.566066 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.566149 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.566078 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.568328 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.568312 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.568497 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.568473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.568612 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.568509 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.569114 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569097 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.569203 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569126 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.569203 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569136 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.569203 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569097 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.569203 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569188 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.569366 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.569205 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.571298 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.571282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.571353 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.571308 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:47.572185 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.572167 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:47.572262 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.572204 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:47.572262 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.572221 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:47.597194 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.597174 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.600227 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.600208 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.627687 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.627662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.627774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.627692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.627774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.627715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.654271 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.654244 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.728033 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.728033 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.728248 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.728248 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.728248 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.728248 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.728134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.755186 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.755132 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.855871 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.855828 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:47.901031 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.901005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.903099 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:47.903081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:47.957046 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:47.956874 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.057468 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.057378 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.157874 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.157844 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.258377 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.258348 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.264557 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.264539 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 17:28:48.359105 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.359031 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.460020 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.459989 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.460020 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.459998 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:28:48.462432 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.462413 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:28:48.462546 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.462444 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:28:48.462546 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.462457 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:28:48.498504 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.498443 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 17:23:47 +0000 UTC" deadline="2028-05-21 02:56:57.175361853 +0000 UTC" Nov 03 17:28:48.498504 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.498496 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13545h28m8.676867873s" Nov 03 17:28:48.551769 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.551737 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:28:48.560847 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.560815 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.572679 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.572635 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:28:48.659241 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.659103 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:28:48.660055 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:48.660018 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6d5118fb6c640821cbaa8f5802c9ee.slice/crio-c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9 WatchSource:0}: Error finding container c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9: Status 404 returned error can't find the container with id c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9 Nov 03 17:28:48.661199 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:48.661177 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:28:48.661925 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:48.661901 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd3375087b535eb1ba3fbe0bafa7b69.slice/crio-60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c WatchSource:0}: Error finding container 60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c: Status 404 returned error can't find the container with id 60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c Nov 03 17:28:48.665634 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.665619 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:28:48.671084 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.671068 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:28:48.726948 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.726913 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:48.746439 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.746419 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:28:48.747266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.747252 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:28:48.757361 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:48.757341 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:28:49.303191 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.303163 2576 apiserver.go:52] "Watching apiserver" Nov 03 17:28:49.313051 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.313027 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 17:28:49.313358 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.313340 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wfd8s","kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal","openshift-network-diagnostics/network-check-target-ld2j9","openshift-ovn-kubernetes/ovnkube-node-slpkv","kube-system/global-pull-secret-syncer-j72rg","openshift-cluster-node-tuning-operator/tuned-8pmql","openshift-multus/multus-xrhqr","openshift-multus/network-metrics-daemon-c4sp7","kube-system/konnectivity-agent-rzndd","openshift-image-registry/node-ca-l8ftc","openshift-network-operator/iptables-alerter-nkxl4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp","openshift-dns/node-resolver-9zk8s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal"] Nov 03 17:28:49.316018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.315999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.318318 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.318296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.320835 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.320678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.325248 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.325224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.326665 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.326293 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 17:28:49.327506 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.327483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.327686 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.327595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:49.329824 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.329804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.332781 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.332760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.333737 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.333716 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.333830 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.333715 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.334295 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.334273 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.334393 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.334347 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.335658 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.335307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.335658 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.335431 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.335975 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336048 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336052 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mh8gc\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336057 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336074 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sqcgc\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336109 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336116 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336126 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336168 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4fnz\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336169 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 17:28:49.336195 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336180 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-jdtg9\"" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.336816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.336991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxlg\" (UniqueName: \"kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rsb\" (UniqueName: \"kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337275 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n78cz\" (UniqueName: \"kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9wp\" (UniqueName: \"kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337613 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55x7c\"" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337668 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337851 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.337852 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337965 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.337993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.338443 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.338281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.339286 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.339147 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.339286 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.339164 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.339286 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.339184 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 17:28:49.341153 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.341131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.343477 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.343310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:49.343477 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.343452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:49.346051 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.345937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.391075 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.391046 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 17:28:49.391197 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.391131 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpxzn" Nov 03 17:28:49.405770 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.405719 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpxzn" Nov 03 17:28:49.428362 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.428328 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 17:28:49.438579 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.438735 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksg28\" (UniqueName: \"kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtmz\" (UniqueName: \"kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9wp\" (UniqueName: \"kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.438976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.439049 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nggt\" (UniqueName: \"kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.439774 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x44hk\" (UniqueName: \"kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.439998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.440607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rsb\" (UniqueName: \"kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78cz\" (UniqueName: \"kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-762g7\" (UniqueName: \"kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.441444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxlg\" (UniqueName: \"kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.440917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.441536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.441767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.442234 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442875 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 17:28:49.442991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.442988 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 17:28:49.443293 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443129 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h22mh\"" Nov 03 17:28:49.443293 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443246 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvjzb\"" Nov 03 17:28:49.443394 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443394 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443331 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 17:28:49.443394 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443499 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443413 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 17:28:49.443499 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443499 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443474 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5jpwh\"" Nov 03 17:28:49.443499 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.443954 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.444250 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.443983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.444250 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.444250 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.444404 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444229 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 17:28:49.444404 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444677 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444750 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444770 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444790 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444893 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444939 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444897 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnwnb\"" Nov 03 17:28:49.445019 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.444957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.445304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.445341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.445350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.445455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.445464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.445624 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:49.446266 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.445717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:28:49.945697812 +0000 UTC m=+2.985115599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:49.449663 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.449643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.461040 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.461014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rsb\" (UniqueName: \"kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.462838 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.462808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxlg\" (UniqueName: \"kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.465507 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.464459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9wp\" (UniqueName: \"kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.469849 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.469797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78cz\" (UniqueName: \"kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.470823 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.470775 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"dfd3375087b535eb1ba3fbe0bafa7b69","Type":"ContainerStarted","Data":"60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c"} Nov 03 17:28:49.478413 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.478384 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerStarted","Data":"c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9"} Nov 03 17:28:49.541836 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-762g7\" (UniqueName: \"kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542018 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.541997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksg28\" (UniqueName: \"kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtmz\" (UniqueName: \"kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.542363 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nggt\" (UniqueName: \"kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44hk\" (UniqueName: \"kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.543212 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.542929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.543025 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.543039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.543085 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:28:50.043065599 +0000 UTC m=+3.082483375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.543111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.543343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.543953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.544014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.543980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544619 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544619 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.544619 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.544801 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.544768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.545325 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.545271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.545325 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.545286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.545617 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.545570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.546943 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.546897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.547625 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.547602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.560312 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.560251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-762g7\" (UniqueName: \"kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.561924 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.561904 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:28:49.562005 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.561929 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:28:49.562005 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.561945 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:49.562125 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.562020 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:28:50.061999409 +0000 UTC m=+3.101417194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:49.562406 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.562383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44hk\" (UniqueName: \"kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:49.565322 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.565296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nggt\" (UniqueName: \"kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.565606 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.565584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksg28\" (UniqueName: \"kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.567886 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.567863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtmz\" (UniqueName: \"kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.638270 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.638239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:28:49.647470 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.647433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:28:49.656541 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.656517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xrhqr" Nov 03 17:28:49.657742 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.657712 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7d29fb_094a_42e2_ae6b_84c6027dfeaf.slice/crio-e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94 WatchSource:0}: Error finding container e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94: Status 404 returned error can't find the container with id e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94 Nov 03 17:28:49.668718 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.668684 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538f7463_1f30_4039_854b_9be1f87673d0.slice/crio-73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49 WatchSource:0}: Error finding container 73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49: Status 404 returned error can't find the container with id 73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49 Nov 03 17:28:49.683358 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.683327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:28:49.689444 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.689424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:28:49.697060 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.696998 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ece6b52_df4d_42dc_8173_ae1db4516094.slice/crio-8635ac66316e104f003c4ba05975f52d7f1511a27a24163c15b17c2d588de9ef WatchSource:0}: Error finding container 8635ac66316e104f003c4ba05975f52d7f1511a27a24163c15b17c2d588de9ef: Status 404 returned error can't find the container with id 8635ac66316e104f003c4ba05975f52d7f1511a27a24163c15b17c2d588de9ef Nov 03 17:28:49.700694 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.700543 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbcb6a4_1f46_4982_b614_2e838dcf6589.slice/crio-7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e WatchSource:0}: Error finding container 7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e: Status 404 returned error can't find the container with id 7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e Nov 03 17:28:49.701898 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.701781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:49.710149 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.709672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:28:49.712650 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.712556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:28:49.713241 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.713202 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c258f2_553a_4da7_875a_4eb12d044178.slice/crio-291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229 WatchSource:0}: Error finding container 291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229: Status 404 returned error can't find the container with id 291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229 Nov 03 17:28:49.720210 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.720187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:28:49.721526 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.721493 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24bb641_25bd_48fc_80eb_6e7ed5152327.slice/crio-67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054 WatchSource:0}: Error finding container 67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054: Status 404 returned error can't find the container with id 67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054 Nov 03 17:28:49.724518 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.724401 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da9b82_0d11_4c37_899d_cbe95b50213b.slice/crio-15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb WatchSource:0}: Error finding container 15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb: Status 404 returned error can't find the container with id 15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb Nov 03 17:28:49.731731 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:28:49.731708 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd497561_3a6d_487c_a9b1_459f9dd47277.slice/crio-a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934 WatchSource:0}: Error finding container a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934: Status 404 returned error can't find the container with id a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934 Nov 03 17:28:49.947266 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:49.947231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:49.947447 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.947358 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:49.947447 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:49.947424 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:28:50.947408618 +0000 UTC m=+3.986826404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:50.048251 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.048216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:50.048451 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.048388 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:50.048535 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.048463 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:28:51.048442593 +0000 UTC m=+4.087860387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:50.149247 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.149209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:50.149449 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.149409 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:28:50.149449 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.149439 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:28:50.149564 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.149453 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:50.149564 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.149535 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:28:51.149514848 +0000 UTC m=+4.188932641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:50.409077 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.408878 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:23:49 +0000 UTC" deadline="2028-05-17 13:06:47.818154505 +0000 UTC" Nov 03 17:28:50.409077 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.408948 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h37m57.409211978s" Nov 03 17:28:50.465927 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.465342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:50.465927 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.465485 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:50.501292 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.501197 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" event={"ID":"cd497561-3a6d-487c-a9b1-459f9dd47277","Type":"ContainerStarted","Data":"a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934"} Nov 03 17:28:50.513438 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.513397 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rzndd" event={"ID":"05c258f2-553a-4da7-875a-4eb12d044178","Type":"ContainerStarted","Data":"291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229"} Nov 03 17:28:50.517332 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.517293 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pmql" event={"ID":"4ece6b52-df4d-42dc-8173-ae1db4516094","Type":"ContainerStarted","Data":"8635ac66316e104f003c4ba05975f52d7f1511a27a24163c15b17c2d588de9ef"} Nov 03 17:28:50.526690 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.526632 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xrhqr" event={"ID":"538f7463-1f30-4039-854b-9be1f87673d0","Type":"ContainerStarted","Data":"73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49"} Nov 03 17:28:50.535995 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.534479 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zk8s" event={"ID":"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf","Type":"ContainerStarted","Data":"e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94"} Nov 03 17:28:50.538666 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.538338 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nkxl4" event={"ID":"75c58a6b-ff67-4ba5-b02f-15054b69a244","Type":"ContainerStarted","Data":"0ae55f6e8dc1961a8b6fb654438cb088a422198036c7e8db5ab64442d49e38e1"} Nov 03 17:28:50.545230 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.545198 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8ftc" event={"ID":"c6da9b82-0d11-4c37-899d-cbe95b50213b","Type":"ContainerStarted","Data":"15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb"} Nov 03 17:28:50.549569 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.549505 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerStarted","Data":"67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054"} Nov 03 17:28:50.573942 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.573744 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e"} Nov 03 17:28:50.955743 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:50.955039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:50.955743 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.955221 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:50.955743 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:50.955291 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:28:52.955272479 +0000 UTC m=+5.994690265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:51.056376 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.056343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:51.056610 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.056577 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:51.056713 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.056659 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:28:53.056639942 +0000 UTC m=+6.096057712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:51.157090 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.157036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:51.157258 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.157216 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:28:51.157258 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.157236 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:28:51.157258 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.157250 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:51.157419 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.157371 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:28:53.157298702 +0000 UTC m=+6.196716483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:51.409897 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.409799 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:23:49 +0000 UTC" deadline="2028-04-24 20:08:25.456871408 +0000 UTC" Nov 03 17:28:51.409897 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.409864 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12914h39m34.047011817s" Nov 03 17:28:51.466727 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.465070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:51.466727 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.465234 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:51.466727 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.465285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:51.466727 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:51.465404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:51.583672 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.583569 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"dfd3375087b535eb1ba3fbe0bafa7b69","Type":"ContainerStarted","Data":"4da8b8884a3a9431c1532b3aa7fe13fe2261e5b3d4329f9eb99343ec75c31f05"} Nov 03 17:28:51.616611 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:51.615837 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" podStartSLOduration=2.615817382 podStartE2EDuration="2.615817382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:51.614624242 +0000 UTC m=+4.654042038" watchObservedRunningTime="2026-11-03 17:28:51.615817382 +0000 UTC m=+4.655235179" Nov 03 17:28:52.465912 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:52.465212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:52.465912 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:52.465487 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:52.610295 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:52.608897 2576 generic.go:356] "Generic (PLEG): container finished" podID="1d6d5118fb6c640821cbaa8f5802c9ee" containerID="5cc527798a1e1251406b4b8a8ff70a12f8a1479040c1845a697784744eee4a9b" exitCode=0 Nov 03 17:28:52.610295 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:52.610032 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerDied","Data":"5cc527798a1e1251406b4b8a8ff70a12f8a1479040c1845a697784744eee4a9b"} Nov 03 17:28:52.974471 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:52.973809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:52.974471 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:52.973991 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:52.974471 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:52.974060 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:28:56.974039967 +0000 UTC m=+10.013457753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:53.075101 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.074392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:53.075101 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.074642 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:53.075101 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.074718 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:28:57.074698654 +0000 UTC m=+10.114116440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:53.176941 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.174800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:53.176941 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.174967 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:28:53.176941 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.174983 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:28:53.176941 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.174992 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:53.176941 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.175040 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:28:57.175022521 +0000 UTC m=+10.214440295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:53.465796 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.465755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:53.465958 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.465919 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:53.466271 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.465943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:53.466271 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:53.466082 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:53.618403 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.618352 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerStarted","Data":"2aa1793a8654b42246a81250924e82f1a0564ee6538164a005680b7975a636e3"} Nov 03 17:28:53.621610 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.621574 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="41d7fec6906b2b7739039c4d746a0dbaa77d1c2ae917343d5be57ba71bf702fb" exitCode=0 Nov 03 17:28:53.621767 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.621633 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"41d7fec6906b2b7739039c4d746a0dbaa77d1c2ae917343d5be57ba71bf702fb"} Nov 03 17:28:53.676590 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:53.673036 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" podStartSLOduration=4.673012267 podStartE2EDuration="4.673012267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:53.639911999 +0000 UTC m=+6.679329792" watchObservedRunningTime="2026-11-03 17:28:53.673012267 +0000 UTC m=+6.712430066" Nov 03 17:28:54.465409 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:54.465377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:54.465547 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:54.465520 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:55.467590 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.467550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:55.468059 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:55.467905 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:55.468207 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.467661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:55.468302 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:55.468285 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:55.634828 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.634790 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rzndd" event={"ID":"05c258f2-553a-4da7-875a-4eb12d044178","Type":"ContainerStarted","Data":"8735c58db3a62dc436f4d332b03fc5c3ee208a97f1d9e5d280a2aa608087f742"} Nov 03 17:28:55.639791 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.639735 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8ftc" event={"ID":"c6da9b82-0d11-4c37-899d-cbe95b50213b","Type":"ContainerStarted","Data":"73d72912f18c730f09528bb3779749daa8c59384886b2d1a0e176a88d87187da"} Nov 03 17:28:55.652914 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.652861 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rzndd" podStartSLOduration=2.9416189729999997 podStartE2EDuration="7.652843952s" totalImagesPullingTime="4.711224979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:55.652472443 +0000 UTC m=+8.691890237" watchObservedRunningTime="2026-11-03 17:28:55.652843952 +0000 UTC m=+8.692261744" Nov 03 17:28:55.671280 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:55.671222 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8ftc" podStartSLOduration=2.280275676 podStartE2EDuration="7.671204715s" totalImagesPullingTime="5.390929039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:55.67082917 +0000 UTC m=+8.710246961" watchObservedRunningTime="2026-11-03 17:28:55.671204715 +0000 UTC m=+8.710622496" Nov 03 17:28:56.464992 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:56.464959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:56.465159 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:56.465094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:56.652615 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:56.652317 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" event={"ID":"cd497561-3a6d-487c-a9b1-459f9dd47277","Type":"ContainerStarted","Data":"51ccd6b92875b40ca8d89da145813422b0d457f308f15add4de5c07f9ec1590c"} Nov 03 17:28:57.009929 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.009891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:57.010120 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.010059 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:57.010183 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.010133 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:05.010110475 +0000 UTC m=+18.049528257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:28:57.110770 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.110733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:57.110904 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.110868 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:57.110958 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.110931 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:05.110913515 +0000 UTC m=+18.150331288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:28:57.212072 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.212035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:57.212334 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.212304 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:28:57.212418 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.212368 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:28:57.212418 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.212382 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:57.212526 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.212443 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:29:05.212425089 +0000 UTC m=+18.251842861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:28:57.467889 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.467836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:57.468040 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.468007 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:57.468337 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.468320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:57.468406 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:57.468392 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:57.716622 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:57.716585 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 17:28:58.400975 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.400852 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T17:28:57.716604584Z","UUID":"e892405c-aa27-4e52-964e-940dbdae8c5e","Handler":null,"Name":"","Endpoint":""} Nov 03 17:28:58.402990 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.402963 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 17:28:58.403119 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.403000 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 17:28:58.464848 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.464820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:28:58.464985 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:58.464956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:28:58.662294 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.662260 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zk8s" event={"ID":"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf","Type":"ContainerStarted","Data":"f89406b43250ddd1f033bf022d0b837b7d9385dd949c03b7e3c3d8f37f4ac09e"} Nov 03 17:28:58.664538 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.664509 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="dafa14fd2276fd7ee830bf2c63ab7471512cd8288e32f5e8a05981488d87eda7" exitCode=0 Nov 03 17:28:58.664669 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.664611 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"dafa14fd2276fd7ee830bf2c63ab7471512cd8288e32f5e8a05981488d87eda7"} Nov 03 17:28:58.667518 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.667496 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" event={"ID":"cd497561-3a6d-487c-a9b1-459f9dd47277","Type":"ContainerStarted","Data":"1b9b22d40a1b713dd0bc2d4ba5c7e60a8d50fd52886fc2e0aff53f97af039707"} Nov 03 17:28:58.669260 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.669221 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xrhqr" event={"ID":"538f7463-1f30-4039-854b-9be1f87673d0","Type":"ContainerStarted","Data":"4bde45aa69c901be8ced07c44983b3d64bc0f79ca7343d468749627495970bc7"} Nov 03 17:28:58.679782 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.679726 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-9zk8s" podStartSLOduration=3.362085859 podStartE2EDuration="11.679710733s" totalImagesPullingTime="8.317624874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:58.679470146 +0000 UTC m=+11.718887937" watchObservedRunningTime="2026-11-03 17:28:58.679710733 +0000 UTC m=+11.719128525" Nov 03 17:28:58.725161 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:58.725090 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-xrhqr" podStartSLOduration=2.794364642 podStartE2EDuration="10.725071784s" totalImagesPullingTime="7.930707142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:58.72436225 +0000 UTC m=+11.763780041" watchObservedRunningTime="2026-11-03 17:28:58.725071784 +0000 UTC m=+11.764489575" Nov 03 17:28:59.466082 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.465761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:28:59.466438 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:59.466285 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:28:59.467432 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.467407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:28:59.467704 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:28:59.467678 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:28:59.484207 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.484176 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:59.484844 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.484822 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:28:59.674640 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.674604 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" event={"ID":"cd497561-3a6d-487c-a9b1-459f9dd47277","Type":"ContainerStarted","Data":"4c042b698a833ffacd3bd1f8c21dbd1fa31db27a74522e4ea6857820b4d8c390"} Nov 03 17:28:59.677528 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.677502 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nkxl4" event={"ID":"75c58a6b-ff67-4ba5-b02f-15054b69a244","Type":"ContainerStarted","Data":"0ef822ac2c7f5ed3b8beb25d934ae1d28428b2f2026bc922af261ab9a517be11"} Nov 03 17:28:59.680828 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.680799 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="3992f813b29d679131c049efaa28248779969ba5c6d19165f0068d41fc5b0cd1" exitCode=0 Nov 03 17:28:59.681705 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.681685 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"3992f813b29d679131c049efaa28248779969ba5c6d19165f0068d41fc5b0cd1"} Nov 03 17:28:59.695412 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.695326 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" podStartSLOduration=3.090141088 podStartE2EDuration="11.695310621s" totalImagesPullingTime="8.605169533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:59.694938332 +0000 UTC m=+12.734356123" watchObservedRunningTime="2026-11-03 17:28:59.695310621 +0000 UTC m=+12.734728413" Nov 03 17:28:59.711473 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:28:59.711414 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nkxl4" podStartSLOduration=4.1519263 podStartE2EDuration="12.711399024s" totalImagesPullingTime="8.559472724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:59.711132143 +0000 UTC m=+12.750549933" watchObservedRunningTime="2026-11-03 17:28:59.711399024 +0000 UTC m=+12.750816813" Nov 03 17:29:00.465222 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:00.465199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:00.465673 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:00.465297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:00.684867 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:00.684831 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pmql" event={"ID":"4ece6b52-df4d-42dc-8173-ae1db4516094","Type":"ContainerStarted","Data":"79347ee0894e9fa2bfa10d662a495f5803a1d87523890010c8bb18b35e817792"} Nov 03 17:29:00.687985 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:00.687958 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerStarted","Data":"78f78e945bb1e551ec1017720ba016d3191f5857ddeb38774cf0446aa43df614"} Nov 03 17:29:00.708121 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:00.708066 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8pmql" podStartSLOduration=1.985233017 podStartE2EDuration="12.708047945s" totalImagesPullingTime="10.722814928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:00.707647324 +0000 UTC m=+13.747065139" watchObservedRunningTime="2026-11-03 17:29:00.708047945 +0000 UTC m=+13.747465736" Nov 03 17:29:01.465205 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:01.465170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:01.465372 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:01.465338 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:01.465955 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:01.465878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:01.466034 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:01.466012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:01.692508 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:01.692473 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="78f78e945bb1e551ec1017720ba016d3191f5857ddeb38774cf0446aa43df614" exitCode=0 Nov 03 17:29:01.692702 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:01.692588 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"78f78e945bb1e551ec1017720ba016d3191f5857ddeb38774cf0446aa43df614"} Nov 03 17:29:02.464782 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:02.464745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:02.464994 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:02.464891 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:03.465031 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:03.464827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:03.465678 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:03.464874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:03.465678 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:03.465142 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:03.465678 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:03.465219 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:03.700991 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:03.700914 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerStarted","Data":"a54190b4c5ed2b2c66d9b67ef9c6b0e31467edb91b39acf5d911d49ab067254c"} Nov 03 17:29:04.464952 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.464920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:04.465052 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:04.465031 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:04.705716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.705464 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="a54190b4c5ed2b2c66d9b67ef9c6b0e31467edb91b39acf5d911d49ab067254c" exitCode=0 Nov 03 17:29:04.705716 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.705547 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"a54190b4c5ed2b2c66d9b67ef9c6b0e31467edb91b39acf5d911d49ab067254c"} Nov 03 17:29:04.708471 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.708453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:04.708828 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.708804 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbbcb6a4-1f46-4982-b614-2e838dcf6589" containerID="50d85b9a034effaeb9e41268f355a5c5acb2a687883c51a95452a182b020f18e" exitCode=1 Nov 03 17:29:04.708888 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.708842 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"5b318e7746636705a1ec9e43ac539a563269628fe2d3df902dbb8b9df4082f6c"} Nov 03 17:29:04.708940 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.708917 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"6abee7126c3a3d3e64638df258ccc85f4d016e49363c76b1458da7fff1fc5306"} Nov 03 17:29:04.708998 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.708983 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"5c06f099aed4e126b8c619c5c2164078c054a8ac72102ff0f01aa27c536c16de"} Nov 03 17:29:04.709050 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.709039 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"c2973c9db1498ca36910b045df437f8a9535efb3cfb2dfb1aeba584bf7c21e6e"} Nov 03 17:29:04.709100 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.709089 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerDied","Data":"50d85b9a034effaeb9e41268f355a5c5acb2a687883c51a95452a182b020f18e"} Nov 03 17:29:04.709147 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:04.709136 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"c20b7bc4d7cff69b0d3154ce31f2a34ba45745a07f8ebac2250c9e3b8caa9b5a"} Nov 03 17:29:05.074884 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.074787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:05.075016 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.074926 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 17:29:05.075016 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.074981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret podName:db4a2814-a7a4-4181-9e07-d433c6ea5e1b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:21.074968261 +0000 UTC m=+34.114386033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret") pod "global-pull-secret-syncer-j72rg" (UID: "db4a2814-a7a4-4181-9e07-d433c6ea5e1b") : object "kube-system"/"original-pull-secret" not registered Nov 03 17:29:05.176105 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.176068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:05.176295 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.176183 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:29:05.176295 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.176233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:21.176221416 +0000 UTC m=+34.215639186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 17:29:05.277316 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.277280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:05.277509 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.277458 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 17:29:05.277509 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.277484 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 17:29:05.277509 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.277497 2576 projected.go:196] Error preparing data for projected volume kube-api-access-ndxvj for pod openshift-network-diagnostics/network-check-target-ld2j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:29:05.277687 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.277563 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj podName:de29fa43-1b3b-4505-9332-468e7d6b196d nodeName:}" failed. No retries permitted until 2026-11-03 17:29:21.277544146 +0000 UTC m=+34.316961927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ndxvj" (UniqueName: "kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj") pod "network-check-target-ld2j9" (UID: "de29fa43-1b3b-4505-9332-468e7d6b196d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 17:29:05.465014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.464980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:05.465014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.465021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:05.465558 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.465120 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:05.465558 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:05.465263 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:05.715590 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.715498 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="01ceaf5f597dbcb168a9b07519eaa9af673c9a1d6623114287a7ef854d569322" exitCode=0 Nov 03 17:29:05.715590 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:05.715541 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerDied","Data":"01ceaf5f597dbcb168a9b07519eaa9af673c9a1d6623114287a7ef854d569322"} Nov 03 17:29:06.464646 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:06.464620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:06.464834 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:06.464719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:06.721563 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:06.721482 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" event={"ID":"a24bb641-25bd-48fc-80eb-6e7ed5152327","Type":"ContainerStarted","Data":"82b754ed647fb26698bb99f3d4da12240c8de4e44b9ce5e923bb883316c04379"} Nov 03 17:29:06.724436 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:06.724415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:06.724727 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:06.724694 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"4c1f91dd448d86f6e69e6bb099ca1a261424d9ab4a8e79008d0867193c197c7e"} Nov 03 17:29:07.465555 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:07.465518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:07.465750 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:07.465657 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:07.465750 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:07.465701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:07.465865 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:07.465795 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:08.464761 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:08.464717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:08.465236 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:08.464826 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:09.465345 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.465091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:09.465917 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.465149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:09.465917 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:09.465464 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:09.465917 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:09.465485 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:09.736414 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.736337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:09.736816 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.736781 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"49e31046803b67a5f9082a01bd7ec81c0d6aa98e22a9a2b0200adb513b29b465"} Nov 03 17:29:09.737149 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.737119 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:09.737245 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.737224 2576 scope.go:122] "RemoveContainer" containerID="50d85b9a034effaeb9e41268f355a5c5acb2a687883c51a95452a182b020f18e" Nov 03 17:29:09.752496 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.752476 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:09.773121 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:09.773083 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wfd8s" podStartSLOduration=10.480329189 podStartE2EDuration="21.77307081s" totalImagesPullingTime="11.292741621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:06.751495742 +0000 UTC m=+19.790913545" watchObservedRunningTime="2026-11-03 17:29:09.77307081 +0000 UTC m=+22.812488599" Nov 03 17:29:10.464896 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.464866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:10.465038 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:10.464978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:10.515586 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.515533 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j72rg"] Nov 03 17:29:10.518281 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.518255 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ld2j9"] Nov 03 17:29:10.518433 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.518363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:10.518510 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:10.518486 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:10.518953 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.518933 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4sp7"] Nov 03 17:29:10.519030 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.519018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:10.519121 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:10.519106 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:10.742313 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.742245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:10.742659 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.742633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:10.742786 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.742658 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" event={"ID":"fbbcb6a4-1f46-4982-b614-2e838dcf6589","Type":"ContainerStarted","Data":"7d859b203864198066c493db04e9d59921e6212fb2941fd26647f03338764e67"} Nov 03 17:29:10.742786 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:10.742731 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:10.742786 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.742743 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:10.742923 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.742884 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:10.757844 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.757819 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:10.778741 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:10.778694 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" podStartSLOduration=8.325734322 podStartE2EDuration="22.77868134s" totalImagesPullingTime="14.452947018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:10.778330141 +0000 UTC m=+23.817747931" watchObservedRunningTime="2026-11-03 17:29:10.77868134 +0000 UTC m=+23.818099124" Nov 03 17:29:12.464826 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:12.464794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:12.464826 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:12.464815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:12.464826 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:12.464833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:12.465343 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:12.464901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:12.465343 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:12.465011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:12.465343 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:12.465071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:14.464712 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.464666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:14.465143 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.464670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:14.465143 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:14.464781 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:14.465143 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.464669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:14.465143 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:14.464858 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:14.465143 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:14.464930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:14.740316 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.740237 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:14.740556 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.740359 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 17:29:14.740775 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:14.740760 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:16.464956 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:16.464922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:16.465336 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:16.464922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:16.465336 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:16.465023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld2j9" podUID="de29fa43-1b3b-4505-9332-468e7d6b196d" Nov 03 17:29:16.465336 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:16.465055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:16.465336 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:16.465154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4sp7" podUID="5b30fa2c-c31b-48f4-b942-d3a98813859f" Nov 03 17:29:16.465336 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:16.465232 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j72rg" podUID="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" Nov 03 17:29:17.221603 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.221558 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeReady" Nov 03 17:29:17.221785 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.221731 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 17:29:17.309853 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.309825 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wznnr"] Nov 03 17:29:17.327155 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.327121 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c5rrv"] Nov 03 17:29:17.327298 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.327234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.334522 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.334487 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wznnr"] Nov 03 17:29:17.334702 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.334629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.348130 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.343861 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5rrv"] Nov 03 17:29:17.350797 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.350775 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 17:29:17.350911 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.350890 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 17:29:17.350987 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.350968 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 17:29:17.365331 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.365306 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 17:29:17.365524 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.365496 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-crwt4\"" Nov 03 17:29:17.365610 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.365529 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 17:29:17.365645 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.365636 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ht62h\"" Nov 03 17:29:17.463416 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.463603 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdq27\" (UniqueName: \"kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.463603 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv74m\" (UniqueName: \"kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.463721 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.463721 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.463788 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.463729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.565152 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.565152 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.565152 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.565638 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.565638 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdq27\" (UniqueName: \"kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.565638 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv74m\" (UniqueName: \"kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.565638 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:17.565416 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:17.565638 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:17.565488 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:18.065468426 +0000 UTC m=+31.104886230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:17.565815 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.565904 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.565886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.569375 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.569349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.581780 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.581749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv74m\" (UniqueName: \"kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:17.583329 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.583305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdq27\" (UniqueName: \"kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.643927 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.643894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:17.969900 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:17.969866 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wznnr"] Nov 03 17:29:17.973066 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:17.973041 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc01ca73_d0da_40ec_bd7f_abd606f41e93.slice/crio-c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373 WatchSource:0}: Error finding container c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373: Status 404 returned error can't find the container with id c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373 Nov 03 17:29:18.069420 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.069379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:18.069615 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:18.069498 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:18.069615 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:18.069556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:19.069541738 +0000 UTC m=+32.108959507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:18.465405 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.465370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:18.465607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.465432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:18.465607 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.465439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:18.469851 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469822 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 17:29:18.469851 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469844 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-r6gv4\"" Nov 03 17:29:18.469851 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469844 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 17:29:18.470079 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469878 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-t8dmr\"" Nov 03 17:29:18.470079 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469884 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 17:29:18.470079 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469924 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-592l9\"" Nov 03 17:29:18.470079 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.469970 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 17:29:18.762847 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:18.762765 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wznnr" event={"ID":"dc01ca73-d0da-40ec-bd7f-abd606f41e93","Type":"ContainerStarted","Data":"c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373"} Nov 03 17:29:19.076165 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:19.076087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:19.076327 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:19.076245 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:19.076327 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:19.076317 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:21.076296806 +0000 UTC m=+34.115714585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:21.092473 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.092379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:21.092473 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.092431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:21.092915 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:21.092524 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:21.092915 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:21.092591 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:25.092576082 +0000 UTC m=+38.131993862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:21.094667 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.094643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:21.193642 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.193604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:21.193828 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:21.193776 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 17:29:21.193893 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:21.193860 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:53.193840207 +0000 UTC m=+66.233257978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : secret "metrics-daemon-secret" not found Nov 03 17:29:21.201906 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.201877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:21.295161 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.294149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:21.297265 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.297240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:21.503632 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.503601 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j72rg"] Nov 03 17:29:21.506438 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:21.506414 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4a2814_a7a4_4181_9e07_d433c6ea5e1b.slice/crio-e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1 WatchSource:0}: Error finding container e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1: Status 404 returned error can't find the container with id e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1 Nov 03 17:29:21.520636 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.520616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:21.771763 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.771668 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wznnr" event={"ID":"dc01ca73-d0da-40ec-bd7f-abd606f41e93","Type":"ContainerStarted","Data":"b268777570a9a660ae4e3a44e8c4f8eb3d3b5b9c9738f1aa1aa71d849e3d1dd3"} Nov 03 17:29:21.772829 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.772810 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j72rg" event={"ID":"db4a2814-a7a4-4181-9e07-d433c6ea5e1b","Type":"ContainerStarted","Data":"e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1"} Nov 03 17:29:21.791486 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.791442 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wznnr" podStartSLOduration=1.905969056 podStartE2EDuration="4.791428985s" totalImagesPullingTime="2.885459929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:21.79013885 +0000 UTC m=+34.829556639" watchObservedRunningTime="2026-11-03 17:29:21.791428985 +0000 UTC m=+34.830846775" Nov 03 17:29:21.814948 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:21.814914 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ld2j9"] Nov 03 17:29:21.818066 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:21.818034 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde29fa43_1b3b_4505_9332_468e7d6b196d.slice/crio-1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e WatchSource:0}: Error finding container 1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e: Status 404 returned error can't find the container with id 1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e Nov 03 17:29:22.777506 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:22.777467 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ld2j9" event={"ID":"de29fa43-1b3b-4505-9332-468e7d6b196d","Type":"ContainerStarted","Data":"1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e"} Nov 03 17:29:23.556538 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.556497 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:29:23.576623 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.576582 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jcf5"] Nov 03 17:29:23.576776 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.576714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.594763 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.594729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.606152 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.606123 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:29:23.607223 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.607202 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 03 17:29:23.608330 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.608305 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 17:29:23.608330 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.608311 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 17:29:23.608455 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.608342 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 17:29:23.608455 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.608419 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s8vnj\"" Nov 03 17:29:23.608455 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.608436 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4s9f9\"" Nov 03 17:29:23.613882 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.613861 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 17:29:23.613982 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.613942 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 03 17:29:23.625173 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.625142 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jcf5"] Nov 03 17:29:23.712688 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.712847 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.712847 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.712847 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.712995 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.712995 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.712913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6b5n\" (UniqueName: \"kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.713056 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.713009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.713087 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.713051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.713118 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.713080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.814173 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.814173 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.814173 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6b5n\" (UniqueName: \"kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.814745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:23.814819 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 17:29:23.815002 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:23.814877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:24.314859589 +0000 UTC m=+37.354277582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : configmap "kube-rbac-proxy" not found Nov 03 17:29:23.815548 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.815110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.815548 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.815322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815548 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:23.815379 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:23.815548 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:23.815431 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:24.315415306 +0000 UTC m=+37.354833089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:23.815846 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.815608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.815908 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.815881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.829789 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.829758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6b5n\" (UniqueName: \"kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:23.829789 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.829787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:23.901439 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:23.901399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:24.031814 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.031771 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz"] Nov 03 17:29:24.050720 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.050683 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz"] Nov 03 17:29:24.050917 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.050795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:24.067657 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.067555 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-459lb\"" Nov 03 17:29:24.068014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.067975 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 03 17:29:24.068014 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.067998 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 03 17:29:24.208479 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.208407 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:29:24.211327 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:24.211297 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ad57d5_5fb7_4db3_ac50_d011675b0ca4.slice/crio-4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58 WatchSource:0}: Error finding container 4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58: Status 404 returned error can't find the container with id 4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58 Nov 03 17:29:24.217817 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.217795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvg4m\" (UniqueName: \"kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m\") pod \"migrator-66df5d496b-rbgxz\" (UID: \"abc4e194-5ae1-48cd-9b1b-2168ac647739\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:24.319148 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.319059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:24.319148 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:24.319096 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:24.319348 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.319168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:24.319348 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.319219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvg4m\" (UniqueName: \"kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m\") pod \"migrator-66df5d496b-rbgxz\" (UID: \"abc4e194-5ae1-48cd-9b1b-2168ac647739\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:24.319348 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:24.319276 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 17:29:24.319348 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:24.319327 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:25.319309254 +0000 UTC m=+38.358727040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : configmap "kube-rbac-proxy" not found Nov 03 17:29:24.319348 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:24.319347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:25.319337459 +0000 UTC m=+38.358755230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:24.331337 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.331303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvg4m\" (UniqueName: \"kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m\") pod \"migrator-66df5d496b-rbgxz\" (UID: \"abc4e194-5ae1-48cd-9b1b-2168ac647739\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:24.378110 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.378070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:24.544095 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.544061 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gxqhh"] Nov 03 17:29:24.570453 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.570381 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gxqhh"] Nov 03 17:29:24.570623 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.570498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.575432 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.575409 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 03 17:29:24.575561 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.575445 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 03 17:29:24.575561 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.575490 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 03 17:29:24.575561 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.575521 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 03 17:29:24.575703 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.575623 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8nzjt\"" Nov 03 17:29:24.669360 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.669321 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz"] Nov 03 17:29:24.672526 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:24.672498 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc4e194_5ae1_48cd_9b1b_2168ac647739.slice/crio-03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e WatchSource:0}: Error finding container 03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e: Status 404 returned error can't find the container with id 03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e Nov 03 17:29:24.723920 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.723884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.724096 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.723944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5srq4\" (UniqueName: \"kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.724158 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.724139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.784315 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.784279 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" event={"ID":"abc4e194-5ae1-48cd-9b1b-2168ac647739","Type":"ContainerStarted","Data":"03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e"} Nov 03 17:29:24.785756 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.785685 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" event={"ID":"83ad57d5-5fb7-4db3-ac50-d011675b0ca4","Type":"ContainerStarted","Data":"4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58"} Nov 03 17:29:24.824611 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.824515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.824611 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.824583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.825121 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.824635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5srq4\" (UniqueName: \"kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.825429 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.825404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.827271 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.827246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.837678 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.837649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5srq4\" (UniqueName: \"kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:24.896657 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:24.896618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:25.127545 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:25.127453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:25.127704 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.127629 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:25.127704 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.127683 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:33.127669277 +0000 UTC m=+46.167087049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:25.201529 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:25.201492 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gxqhh"] Nov 03 17:29:25.205497 ip-10-0-141-130 kubenswrapper[2576]: W1103 17:29:25.205462 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0c85c9_5872_471f_890f_e575ed8804da.slice/crio-e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491 WatchSource:0}: Error finding container e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491: Status 404 returned error can't find the container with id e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491 Nov 03 17:29:25.329688 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:25.329465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:25.329688 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:25.329534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:25.329688 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.329662 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:25.329965 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.329746 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:27.329725426 +0000 UTC m=+40.369143209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:25.330087 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.329667 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 17:29:25.330141 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:25.330125 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:27.330109254 +0000 UTC m=+40.369527028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : configmap "kube-rbac-proxy" not found Nov 03 17:29:25.790526 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:25.790440 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" event={"ID":"3f0c85c9-5872-471f-890f-e575ed8804da","Type":"ContainerStarted","Data":"e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491"} Nov 03 17:29:26.795533 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:26.795491 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" event={"ID":"abc4e194-5ae1-48cd-9b1b-2168ac647739","Type":"ContainerStarted","Data":"0e282bb7dfc7396495409570f35387a781236e2a04d217168092cd752e288078"} Nov 03 17:29:26.797577 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:26.797540 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ld2j9" event={"ID":"de29fa43-1b3b-4505-9332-468e7d6b196d","Type":"ContainerStarted","Data":"9155e5bffe353d37c1f04c89b113881aea1758f2d79c624c8a0fc85661f862f3"} Nov 03 17:29:26.797710 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:26.797687 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:26.816067 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:26.815977 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" podStartSLOduration=0.885208719 podStartE2EDuration="2.815957432s" totalImagesPullingTime="1.930748713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:26.81514783 +0000 UTC m=+39.854565623" watchObservedRunningTime="2026-11-03 17:29:26.815957432 +0000 UTC m=+39.855375221" Nov 03 17:29:26.835480 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:26.835423 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ld2j9" podStartSLOduration=34.360099927 podStartE2EDuration="38.83540515s" totalImagesPullingTime="4.475305223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:26.834709469 +0000 UTC m=+39.874127262" watchObservedRunningTime="2026-11-03 17:29:26.83540515 +0000 UTC m=+39.874822941" Nov 03 17:29:27.346461 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:27.346427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:27.346628 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:27.346505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:27.346628 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:27.346609 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 17:29:27.346706 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:27.346651 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:27.346706 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:27.346681 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:31.346662839 +0000 UTC m=+44.386080630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : configmap "kube-rbac-proxy" not found Nov 03 17:29:27.346706 ip-10-0-141-130 kubenswrapper[2576]: E1103 17:29:27.346696 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:31.346690463 +0000 UTC m=+44.386108231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:27.802046 ip-10-0-141-130 kubenswrapper[2576]: I1103 17:29:27.802009 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" event={"ID":"83ad57d5-5fb7-4db3-ac50-d011675b0ca4","Type":"ContainerStarted","Data":"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393"} Nov 03 17:29:28.089722 ip-10-0-141-130 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 17:29:28.099021 ip-10-0-141-130 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 17:29:28.099206 ip-10-0-141-130 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 17:29:28.099268 ip-10-0-141-130 systemd[1]: kubelet.service: Consumed 2.497s CPU time. Nov 03 17:29:28.114305 ip-10-0-141-130 systemd[1]: Starting Kubernetes Kubelet... Nov 03 17:29:28.226294 ip-10-0-141-130 kubenswrapper[4557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:29:28.226294 ip-10-0-141-130 kubenswrapper[4557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 17:29:28.226294 ip-10-0-141-130 kubenswrapper[4557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:29:28.226294 ip-10-0-141-130 kubenswrapper[4557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 17:29:28.229120 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229016 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.229120 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229113 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.229120 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229119 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.229120 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229125 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.229120 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229130 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229136 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229141 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229146 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229152 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229156 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229161 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229165 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229170 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229175 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229180 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229185 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229190 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229195 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229198 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229200 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229204 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229215 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229221 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229226 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.229407 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229231 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229236 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229241 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229247 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229252 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229257 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229262 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229266 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229270 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229275 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229279 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229284 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229288 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229293 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229298 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229304 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229308 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229312 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229316 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229320 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.230213 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229324 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229328 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229332 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229336 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229340 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229343 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229346 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229350 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229355 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229361 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229365 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229372 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229379 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229384 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229388 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229391 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229393 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229396 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229398 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.231013 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229401 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229403 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229406 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229408 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229412 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229416 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229420 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229427 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229435 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229441 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229446 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229451 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229455 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229460 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229464 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229469 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229473 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229476 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229479 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.231803 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229522 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229529 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229532 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229537 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229540 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229542 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229547 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229551 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229555 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229560 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229577 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229582 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229587 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229592 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229596 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229600 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229604 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229607 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229610 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229612 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.232632 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229615 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229618 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229620 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.229625 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230737 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230749 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230754 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230758 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230762 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230766 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230770 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230774 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230779 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230783 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230787 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230792 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230797 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230802 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230807 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.233406 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230812 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230816 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230820 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230825 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230829 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230833 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230837 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230841 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230846 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230850 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230855 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230859 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230863 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230867 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230870 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230873 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230876 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230880 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230882 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230885 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.234114 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230888 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230890 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230893 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230895 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230898 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230901 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230903 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230908 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230912 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230917 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230921 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230929 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230934 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230939 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230943 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230948 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230951 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230955 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230961 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230965 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.234878 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230969 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230973 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230978 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230982 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230987 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230993 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.230999 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231004 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231009 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231012 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231016 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231019 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231022 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231024 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231027 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231030 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231033 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231036 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231038 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.236266 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231041 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231046 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231050 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231055 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231063 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231067 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231072 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231075 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231078 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231082 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231086 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231091 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231096 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231100 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231105 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231110 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231114 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231118 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231122 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231127 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.236965 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231132 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231136 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231141 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231145 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231153 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231160 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231167 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231171 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231176 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231180 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231183 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231188 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231888 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231902 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231907 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231910 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231915 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231920 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231924 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.237710 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231928 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231931 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231936 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231942 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231949 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231954 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231957 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231960 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231962 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231965 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231967 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231970 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231973 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231976 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231980 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231985 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231989 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231995 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.231999 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.238408 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232004 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232007 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232009 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232012 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232015 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232017 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232020 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232024 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232026 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232029 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232035 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232039 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232044 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232049 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232054 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232058 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232061 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232064 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232066 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232069 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.239054 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232072 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232074 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232077 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232080 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232082 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232085 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232088 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232090 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232093 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232097 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232103 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232109 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232113 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232117 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232120 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232123 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232125 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232128 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232130 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232134 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.239973 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232137 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232140 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232143 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232148 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232152 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232157 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232162 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232166 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232169 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232172 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232174 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232177 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232180 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232183 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232185 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232188 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232190 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232193 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232197 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232202 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.240736 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232207 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232211 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232215 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232220 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232223 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232226 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232229 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232231 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232234 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232236 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232240 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232246 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232252 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232257 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232261 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232266 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232270 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232274 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232279 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.241542 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.232284 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232377 4557 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232385 4557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232392 4557 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232399 4557 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232406 4557 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232411 4557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232418 4557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232424 4557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232428 4557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232431 4557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232434 4557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232437 4557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232441 4557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232444 4557 flags.go:64] FLAG: --cgroup-root="" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232447 4557 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232450 4557 flags.go:64] FLAG: --client-ca-file="" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232453 4557 flags.go:64] FLAG: --cloud-provider="external" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232457 4557 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232498 4557 flags.go:64] FLAG: --cluster-domain="" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232504 4557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232508 4557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232511 4557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232515 4557 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 17:29:28.242237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232522 4557 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232526 4557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232531 4557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232539 4557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232544 4557 flags.go:64] FLAG: --contention-profiling="false" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232549 4557 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232554 4557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232559 4557 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232578 4557 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232585 4557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232590 4557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232595 4557 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232599 4557 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232604 4557 flags.go:64] FLAG: --enable-server="true" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232609 4557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232616 4557 flags.go:64] FLAG: --event-burst="100" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232621 4557 flags.go:64] FLAG: --event-qps="50" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232626 4557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232631 4557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232636 4557 flags.go:64] FLAG: --eviction-hard="" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232641 4557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232644 4557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232647 4557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232651 4557 flags.go:64] FLAG: --eviction-soft="" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232655 4557 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 17:29:28.243199 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232660 4557 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232666 4557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232672 4557 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232677 4557 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232682 4557 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232686 4557 flags.go:64] FLAG: --feature-gates="" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232693 4557 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232700 4557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232705 4557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232711 4557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232716 4557 flags.go:64] FLAG: --healthz-port="10248" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232721 4557 flags.go:64] FLAG: --help="false" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232726 4557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232731 4557 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232737 4557 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232741 4557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232747 4557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232751 4557 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232754 4557 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232757 4557 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232760 4557 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232763 4557 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232766 4557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 17:29:28.244711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232769 4557 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232772 4557 flags.go:64] FLAG: --kube-reserved="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232775 4557 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232777 4557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232782 4557 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232786 4557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232790 4557 flags.go:64] FLAG: --lock-file="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232795 4557 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232800 4557 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232805 4557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232814 4557 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232818 4557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232821 4557 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232825 4557 flags.go:64] FLAG: --logging-format="text" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232830 4557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232835 4557 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232844 4557 flags.go:64] FLAG: --manifest-url="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232849 4557 flags.go:64] FLAG: --manifest-url-header="" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232855 4557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232860 4557 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232867 4557 flags.go:64] FLAG: --max-pods="110" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232871 4557 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232876 4557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232881 4557 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232885 4557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 17:29:28.245416 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232889 4557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232894 4557 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232900 4557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232917 4557 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232922 4557 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232927 4557 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232931 4557 flags.go:64] FLAG: --pod-cidr="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232934 4557 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232937 4557 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232941 4557 flags.go:64] FLAG: --pods-per-core="0" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232946 4557 flags.go:64] FLAG: --port="10250" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232951 4557 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232956 4557 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0336a7053491bb522" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232961 4557 flags.go:64] FLAG: --qos-reserved="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232966 4557 flags.go:64] FLAG: --read-only-port="10255" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232972 4557 flags.go:64] FLAG: --register-node="true" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232978 4557 flags.go:64] FLAG: --register-with-taints="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232984 4557 flags.go:64] FLAG: --registry-burst="10" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232989 4557 flags.go:64] FLAG: --registry-qps="5" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.232994 4557 flags.go:64] FLAG: --reserved-cpus="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233001 4557 flags.go:64] FLAG: --reserved-memory="" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233008 4557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233013 4557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233019 4557 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233024 4557 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233029 4557 flags.go:64] FLAG: --runonce="false" Nov 03 17:29:28.246357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233034 4557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233039 4557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233044 4557 flags.go:64] FLAG: --seccomp-default="false" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233050 4557 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233056 4557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233061 4557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233067 4557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233070 4557 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233075 4557 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233079 4557 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233085 4557 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233090 4557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233096 4557 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233101 4557 flags.go:64] FLAG: --system-cgroups="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233106 4557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233112 4557 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233115 4557 flags.go:64] FLAG: --tls-cert-file="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233118 4557 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233123 4557 flags.go:64] FLAG: --tls-min-version="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233126 4557 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233129 4557 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233134 4557 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233139 4557 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233143 4557 flags.go:64] FLAG: --v="2" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233151 4557 flags.go:64] FLAG: --version="false" Nov 03 17:29:28.247349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233158 4557 flags.go:64] FLAG: --vmodule="" Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233165 4557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233171 4557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233395 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233406 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233412 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233416 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233422 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233427 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233431 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233437 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233442 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233447 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233452 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233457 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233463 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233470 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233474 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233479 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.248337 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233484 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233490 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233494 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233499 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233504 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233511 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233515 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233520 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233524 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233528 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233532 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233537 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233541 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233546 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233551 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233555 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233561 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233581 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233586 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233590 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.249128 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233595 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233601 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233605 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233609 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233616 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233622 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233627 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233632 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233637 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233642 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233646 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233651 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233655 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233659 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233664 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233668 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233672 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233679 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233683 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.249895 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233688 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233692 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233696 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233700 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233704 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233708 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233712 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233717 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233721 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233725 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233731 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233736 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233741 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233745 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233749 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233753 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233757 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233762 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233766 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233771 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.250701 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233776 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233780 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233785 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233789 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233794 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233798 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233801 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233804 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233806 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233809 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233814 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233818 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233823 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233828 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233832 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233837 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233840 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233843 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233846 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233849 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.251451 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233852 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233855 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233858 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233861 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233864 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233867 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233871 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233875 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233880 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233885 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233890 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.233939 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233987 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233994 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.233999 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234004 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.252185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234009 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234014 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234020 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234025 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234029 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234035 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234040 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234048 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234053 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234057 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234060 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234063 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234067 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234071 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234076 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234081 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234086 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234090 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234095 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.252723 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234100 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234105 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234110 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234114 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234119 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234124 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234127 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234130 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234135 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234138 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234143 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234147 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234150 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234153 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234157 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234162 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234166 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234171 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234176 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234179 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.253230 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234183 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234186 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234188 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234192 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234197 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234202 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234206 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234210 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234214 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234220 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234225 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234230 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234234 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234239 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234245 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234249 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234254 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234259 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234263 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234267 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.253743 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234272 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234278 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234282 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234286 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234289 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234292 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234298 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234302 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234306 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234309 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234314 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234318 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234324 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234329 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234333 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234337 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234342 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234347 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234351 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.254334 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234354 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234357 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234359 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234362 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234365 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234368 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234370 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234373 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234376 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234379 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234382 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234385 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234388 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234392 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234397 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234403 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234407 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234410 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234413 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.255167 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234417 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234420 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234423 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234426 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.234428 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.239293 4557 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.239308 4557 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.239332 4557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.239340 4557 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239420 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239426 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239431 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239434 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239438 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239443 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239447 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239451 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239455 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239459 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.255836 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239463 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239468 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239473 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239477 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239482 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239486 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239490 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239494 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239500 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239505 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239510 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239515 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239519 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239524 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239529 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239534 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239539 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239544 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239549 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239553 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.256418 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239558 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239577 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239583 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239586 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239589 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239593 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239597 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239601 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239605 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239609 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239611 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239614 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239617 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239621 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239626 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239632 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239637 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239640 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239644 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.257150 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239650 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239655 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239660 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239664 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239668 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239672 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239678 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239683 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239687 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239690 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239693 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239696 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239699 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239701 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239704 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239707 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239709 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239714 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239718 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239724 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.257996 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239729 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239732 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239736 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239738 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239741 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239745 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239749 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239753 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239758 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239763 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239768 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239772 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239776 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239781 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239786 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239790 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239796 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239801 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239807 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.258860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239812 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239817 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239821 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239824 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239826 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239830 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239835 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239839 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239843 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239848 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239853 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239857 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239860 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239863 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239865 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239868 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239871 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.259732 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.239874 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.239916 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240115 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240123 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240128 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240132 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240138 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240143 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240147 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240152 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240157 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240161 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240165 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240170 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240174 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240180 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.260486 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240184 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240189 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240193 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240198 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240203 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240210 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240214 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240219 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240223 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240228 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240233 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240238 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240243 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240249 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240255 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240259 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240263 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240268 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240272 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.261248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240276 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240280 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240285 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240290 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240297 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240301 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240306 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240310 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240315 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240319 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240324 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240331 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240335 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240339 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240343 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240348 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240352 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240357 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240363 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240368 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.262103 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240372 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240375 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240378 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240381 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240383 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240386 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240389 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240391 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240394 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240396 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240399 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240401 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240404 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240408 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240412 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240416 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240421 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240426 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240431 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240435 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.264211 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240439 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240444 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240449 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240457 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240463 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240467 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240472 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240477 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240481 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240485 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240491 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240495 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240499 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240503 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240507 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240512 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240516 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240521 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240525 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.265115 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240529 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240533 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240537 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240542 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240545 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240547 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240551 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240553 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240556 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240560 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240578 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240584 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240589 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240594 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.240642 4557 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240720 4557 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 17:29:28.266053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240732 4557 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240738 4557 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240743 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240747 4557 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240751 4557 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240756 4557 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240761 4557 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240766 4557 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240774 4557 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240778 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240783 4557 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240786 4557 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240791 4557 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240795 4557 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240800 4557 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240805 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240809 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240815 4557 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240822 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 17:29:28.266909 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240827 4557 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240831 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240836 4557 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240840 4557 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240844 4557 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240848 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240853 4557 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240856 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240858 4557 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240864 4557 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240868 4557 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240875 4557 feature_gate.go:386] unrecognized feature gate: Example Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240879 4557 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240887 4557 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240892 4557 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240896 4557 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240901 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240914 4557 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240917 4557 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240920 4557 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 17:29:28.267741 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240923 4557 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240928 4557 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240930 4557 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240933 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240936 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240939 4557 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240941 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240944 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240947 4557 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240949 4557 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240952 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240955 4557 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240958 4557 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240961 4557 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240965 4557 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240970 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240976 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240980 4557 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240985 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 17:29:28.268703 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240990 4557 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240994 4557 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.240997 4557 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241001 4557 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241003 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241007 4557 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241010 4557 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241013 4557 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241016 4557 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241018 4557 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241021 4557 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241023 4557 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241026 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241028 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241034 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241040 4557 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241047 4557 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241052 4557 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241055 4557 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 17:29:28.269531 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241060 4557 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241066 4557 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241070 4557 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241074 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241077 4557 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241079 4557 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241082 4557 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241085 4557 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241088 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241091 4557 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241093 4557 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241096 4557 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241099 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241102 4557 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241104 4557 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241107 4557 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241110 4557 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241113 4557 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241116 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241121 4557 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 17:29:28.270401 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241124 4557 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241126 4557 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241129 4557 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241132 4557 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241136 4557 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241139 4557 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241141 4557 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:28.241145 4557 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.241216 4557 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.247732 4557 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.247812 4557 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.248072 4557 server.go:1014] "Starting client certificate rotation" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.248223 4557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.248284 4557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 17:23:47 +0000 UTC" deadline="2028-04-04 07:03:14.990404257 +0000 UTC" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.248325 4557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12421h33m46.742083081s" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.248731 4557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 17:29:28.271244 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.250262 4557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 17:29:28.272005 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.252305 4557 log.go:25] "Validated CRI v1 runtime API" Nov 03 17:29:28.272005 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.254319 4557 log.go:25] "Validated CRI v1 image API" Nov 03 17:29:28.272005 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.255182 4557 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 17:29:28.272005 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.257165 4557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c6dcacae-b588-48ab-aa8f-75e95ae8a6fc:/dev/nvme0n1p3 f7b42f30-e13e-4666-a3fc-48351d55ddb9:/dev/nvme0n1p4] Nov 03 17:29:28.272211 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.257183 4557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ae55f6e8dc1961a8b6fb654438cb088a422198036c7e8db5ab64442d49e38e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ae55f6e8dc1961a8b6fb654438cb088a422198036c7e8db5ab64442d49e38e1/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05c258f2-553a-4da7-875a-4eb12d044178/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/05c258f2-553a-4da7-875a-4eb12d044178/volumes/kubernetes.io~secret/agent-certs major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~projected/kube-api-access-5srq4:{mountpoint:/var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~projected/kube-api-access-5srq4 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~secret/signing-key major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/tmp major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~projected/kube-api-access-ksg28:{mountpoint:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~projected/kube-api-access-ksg28 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/538f7463-1f30-4039-854b-9be1f87673d0/volumes/kubernetes.io~projected/kube-api-access-qg9wp:{mountpoint:/var/lib/kubelet/pods/538f7463-1f30-4039-854b-9be1f87673d0/volumes/kubernetes.io~projected/kube-api-access-qg9wp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b30fa2c-c31b-48f4-b942-d3a98813859f/volumes/kubernetes.io~projected/kube-api-access-x44hk:{mountpoint:/var/lib/kubelet/pods/5b30fa2c-c31b-48f4-b942-d3a98813859f/volumes/kubernetes.io~projected/kube-api-access-x44hk major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6269505c-e5d3-47ee-bb53-0e932ad0782b/volumes/kubernetes.io~projected/kube-api-access-xv74m:{mountpoint:/var/lib/kubelet/pods/6269505c-e5d3-47ee-bb53-0e932ad0782b/volumes/kubernetes.io~projected/kube-api-access-xv74m major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/75c58a6b-ff67-4ba5-b02f-15054b69a244/volumes/kubernetes.io~projected/kube-api-access-n78cz:{mountpoint:/var/lib/kubelet/pods/75c58a6b-ff67-4ba5-b02f-15054b69a244/volumes/kubernetes.io~projected/kube-api-access-n78cz major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83ad57d5-5fb7-4db3-ac50-d011675b0ca4/volumes/kubernetes.io~projected/kube-api-access-kbj2b:{mountpoint:/var/lib/kubelet/pods/83ad57d5-5fb7-4db3-ac50-d011675b0ca4/volumes/kubernetes.io~projected/kube-api-access-kbj2b major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/99b58fa8-fd3b-4836-a82e-4bc7f7948abb/volumes/kubernetes.io~projected/kube-api-access-z6b5n:{mountpoint:/var/lib/kubelet/pods/99b58fa8-fd3b-4836-a82e-4bc7f7948abb/volumes/kubernetes.io~projected/kube-api-access-z6b5n major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a24bb641-25bd-48fc-80eb-6e7ed5152327/volumes/kubernetes.io~projected/kube-api-access-762g7:{mountpoint:/var/lib/kubelet/pods/a24bb641-25bd-48fc-80eb-6e7ed5152327/volumes/kubernetes.io~projected/kube-api-access-762g7 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/abc4e194-5ae1-48cd-9b1b-2168ac647739/volumes/kubernetes.io~projected/kube-api-access-rvg4m:{mountpoint:/var/lib/kubelet/pods/abc4e194-5ae1-48cd-9b1b-2168ac647739/volumes/kubernetes.io~projected/kube-api-access-rvg4m major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6da9b82-0d11-4c37-899d-cbe95b50213b/volumes/kubernetes.io~projected/kube-api-access-wvtmz:{mountpoint:/var/lib/kubelet/pods/c6da9b82-0d11-4c37-899d-cbe95b50213b/volumes/kubernetes.io~projected/kube-api-access-wvtmz major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd497561-3a6d-487c-a9b1-459f9dd47277/volumes/kubernetes.io~projected/kube-api-access-7nggt:{mountpoint:/var/lib/kubelet/pods/cd497561-3a6d-487c-a9b1-459f9dd47277/volumes/kubernetes.io~projected/kube-api-access-7nggt major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db4a2814-a7a4-4181-9e07-d433c6ea5e1b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/db4a2814-a7a4-4181-9e07-d433c6ea5e1b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~projected/kube-api-access-rdq27:{mountpoint:/var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~projected/kube-api-access-rdq27 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/de29fa43-1b3b-4505-9332-468e7d6b196d/volumes/kubernetes.io~projected/kube-api-access-ndxvj:{mountpoint:/var/lib/kubelet/pods/de29fa43-1b3b-4505-9332-468e7d6b196d/volumes/kubernetes.io~projected/kube-api-access-ndxvj major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf/volumes/kubernetes.io~projected/kube-api-access-86rsb:{mountpoint:/var/lib/kubelet/pods/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf/volumes/kubernetes.io~projected/kube-api-access-86rsb major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~projected/kube-api-access-6jxlg:{mountpoint:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~projected/kube-api-access-6jxlg major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/2107284f26be5f377c54efee076cd6c88def64eaa01ab7549f4dfd40a1d16e5c/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/b26d8c7f8e826de2e6039c274b56a3c8cd68dfb274d28f05080bc89727e052ba/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/237f92c1c59ae4190da53981051fc80faffb93da1cd1b324947d1bfe7e9640f6/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/46287ef56f5b69d51ea80c906d3d544861561939d3bd9d8362f7af1dd2322917/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/03b07af8b493a8382b3858f298cdcf2c696d628c422a741b102ff9e3c8aa4093/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/83ae364f02dea7224292f71e1d2705e604bce02f128a97aa5bc2199894440b3f/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/f7a21690d63cb1716199c6bf31a39d84f75a5f5dc8041f2ffe29e433121a5c25/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/cb3c1324d2d18a214de7bc137633ba4bf4a92d800e41728ec8961670a829ecd3/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/5bc1265f0e625fa4f9e148d27df5cd081a5859d6dbff41d97dd16eca8b7bbaf6/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/87c45a07d4b191bfb49ac8beb02baee76d93870d5fe2b626e84afe8e9cac700d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/67eef2678b34b0f61e1956a7fa3fcea1242695c801f9c01bf6f3cb55e179466a/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/9ae7253bcf06d685e5bd4a0ca40f89d4640c23232c3ceafc0fc9bbde5f790691/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/cd7f73b7a0b0ee6be0e5aeb3ad9b2794d01810b3096a8c7c67110d489f9cbf5f/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/fbf44a5e877600940d9854c18f621011aa40146db00cea2a10552ff7b99ca3b5/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/ceedba791f46a3b7617acf036b157d2826bd4e3e2425b2e363c119e848ab9424/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/a9965094d98d8fe503fea42f5f2f17a1f8b7ca7b1fbf7e24e9f0d9633d5ab35f/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1dc817b893b037ba29730a03875fa05422889cd8c69a740bcc8d2a65d1ce0f6e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/7ba4b64ce2f026005669b751883084b4fa2da7537908e5bb9ac85adab8ca98fe/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/96a0f9010d50c5cca3d41e2cad4adb2496979b57f30acf3c496301dab6b137b1/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e96745ea4262ca907b2c5a7631355325d5763ed028a510b9c3eb66500d2a11c4/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/7ce0118cb355bac7482fc1fd8aba07a8c387e1a3cb4cba08424d4b266bb4e8f0/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/fb89f84bde601f0254b988adefa2872c0fab59de69472963ae22cd689656b9ed/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/f5ca972aebc3ed107cb9f0f0301a67c6167d6e45e646cdcdad24abb4a06197ea/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/b3493affa721c4533bac9093aff279c25b0b8a923c9f1fbec82c8b34b0ef22d1/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/4c2aa3212f24d3d0e3754f6d7b644a3a430bdebe7577a4658f79115524c07a03/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/435e0887a601be384fda66cf21dd7333111db64a59145252f4bc869f641f27e8/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/29e430679c192370b34f39fb2481594522368203a2c25d48a30febdc300ae9c4/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/26c85ac00ba50a1c8248dcf528f05546df56b2ca57960e22512c9ce91434ccc3/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/f124b2dfda7e8b6a44fe758cea3a47109b1dcab746952470e3308bb558519e91/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/eece2fd629e1bad3847fa9c6a5873d16885ab4b0d402ff94a9957b5d2c4d7230/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/81442d4a1210c252be375f9e5e762c28f9ffff96865219994403584dde285992/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/0168f55336ba574bee8db3f463310a4df57f9a2bc141e864ba514e1cfa064406/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-50:{mountpoint:/var/lib/containers/storage/overlay/e1293963bb71ac2630231eca37802803ba937f249835e191528d73b239380a6b/merged major:0 minor:50 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/529c828657bf0eb19c2978c70314a26cb86f526fadb2282b2ed4d06414570483/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7af02b4995954ba16c0fdcb888d769c88bb05517b130fb3205fb6ea20e4b5cda/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/c802496ef0da598eef759ba34f54a2e6d8a014098cd5df0cc89079e7d0af2783/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/2c07d5d41ab71ce0452a811c800d085fbdbbf56735e068550ffb940ae5ca1d3e/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/5e05956545aaace29ebb69d1fae7f636be1711753ee7a4168f5eda56e4f62718/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/78d2d080a86ac1a55572c9dfa2bc34740cc1de0ecb2b06f39b0546e12587dac5/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/622f06a11f0204e317883f012e1f3b92383edd12822c6fcee7fa0568fe359653/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/09b20bbe8965a32b280fc138b5f8dd06b37534eaa2e1bc4c49e7b97d69d0cd9b/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6bdae484fd914fde79f67298a6e5abcab811b2bf6606cdfb272d515c608d2fe6/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.263752 4557 manager.go:217] Machine: {Timestamp:2026-11-03 17:29:28.263253984 +0000 UTC m=+0.100366799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100199 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b88d1ec64655a4cf1898e7e1997e6 SystemUUID:ec2b88d1-ec64-655a-4cf1-898e7e1997e6 BootID:0df82f01-aa38-4ab0-bfa5-fd993cf51fba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~projected/kube-api-access-ksg28 DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/538f7463-1f30-4039-854b-9be1f87673d0/volumes/kubernetes.io~projected/kube-api-access-qg9wp DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/83ad57d5-5fb7-4db3-ac50-d011675b0ca4/volumes/kubernetes.io~projected/kube-api-access-kbj2b DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/abc4e194-5ae1-48cd-9b1b-2168ac647739/volumes/kubernetes.io~projected/kube-api-access-rvg4m DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cd497561-3a6d-487c-a9b1-459f9dd47277/volumes/kubernetes.io~projected/kube-api-access-7nggt DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e985e311347f30b1d38761e4de7b52b1ab58469703017681c85e1441efce0a94/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~projected/kube-api-access-rdq27 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:233 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf/volumes/kubernetes.io~projected/kube-api-access-86rsb DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a24bb641-25bd-48fc-80eb-6e7ed5152327/volumes/kubernetes.io~projected/kube-api-access-762g7 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7a7267fd198904e1c41dfd5e90434fb5a1b48d16b763e2714382d8e25c80688e/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/de29fa43-1b3b-4505-9332-468e7d6b196d/volumes/kubernetes.io~projected/kube-api-access-ndxvj DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/c6da9b82-0d11-4c37-899d-cbe95b50213b/volumes/kubernetes.io~projected/kube-api-access-wvtmz DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a51f934aa75544e789c36e68ea5b305c6b1aebd3268b6d8beec55fed9127f934/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db4a2814-a7a4-4181-9e07-d433c6ea5e1b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/03c61b27153aa42a8c8a8064f2de25b03271f49046078ff5287822b6cfac358e/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-50 DeviceMajor:0 DeviceMinor:50 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/99b58fa8-fd3b-4836-a82e-4bc7f7948abb/volumes/kubernetes.io~projected/kube-api-access-z6b5n DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/291ea0ab09eba92a2c6c5e030072e8db0e749062364206fbe7c6768ecfac9229/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67793540106a3d618fbc7b57b8d74127855705213b73d157eb49ff5f040f8054/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/15369a94702da04c9b4e3923cd9198c7b7132ca214baef4306e2131546e3c9bb/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9c9a9c4cc049547e80fffc436df1aa09734753f99d41145b38e5a3444dc34b1/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/dc01ca73-d0da-40ec-bd7f-abd606f41e93/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/4ece6b52-df4d-42dc-8173-ae1db4516094/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6269505c-e5d3-47ee-bb53-0e932ad0782b/volumes/kubernetes.io~projected/kube-api-access-xv74m DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c4c2b12aba966864ca115b3ba0350cd114dbbb59a4e8ef606e7119bba573c373/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1706ef204ba027297aae1c148a63f839355d2117f5efdd527eca8ef2aef2612e/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e49174f03722b6a84a847e1986518e91feab68f029e95e3869d6fabaf0d9d491/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5b30fa2c-c31b-48f4-b942-d3a98813859f/volumes/kubernetes.io~projected/kube-api-access-x44hk DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/75c58a6b-ff67-4ba5-b02f-15054b69a244/volumes/kubernetes.io~projected/kube-api-access-n78cz DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/05c258f2-553a-4da7-875a-4eb12d044178/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3f0c85c9-5872-471f-890f-e575ed8804da/volumes/kubernetes.io~projected/kube-api-access-5srq4 DeviceMajor:0 DeviceMinor:234 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ae55f6e8dc1961a8b6fb654438cb088a422198036c7e8db5ab64442d49e38e1/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbbcb6a4-1f46-4982-b614-2e838dcf6589/volumes/kubernetes.io~projected/kube-api-access-6jxlg DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/73286bf8bfc7705c4e89e27252ca7d208ba32247677fbed0ebeee7a19fae9a49/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:03c61b27153aa42 MacAddress:12:f8:aa:0d:ba:9f Speed:10000 Mtu:8901} {Name:1706ef204ba0272 MacAddress:a2:00:19:e3:06:e5 Speed:10000 Mtu:8901} {Name:4408d75c3375886 MacAddress:fa:b4:ed:15:ac:ec Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c2:d7:63:89 Speed:0 Mtu:9001} {Name:br-int MacAddress:76:87:f2:00:59:a0 Speed:0 Mtu:8901} {Name:c4c2b12aba96686 MacAddress:8e:85:7d:55:43:67 Speed:10000 Mtu:8901} {Name:e49174f03722b6a MacAddress:4e:7a:5b:2f:23:22 Speed:10000 Mtu:8901} {Name:e9c9a9c4cc04954 MacAddress:72:ba:9e:51:87:56 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c2:d7:63:89 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:62:b3:2f:50:97:98 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:aa:ff:93:d1:87:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264004 4557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264047 4557 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264305 4557 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264324 4557 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-130.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264458 4557 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264465 4557 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264479 4557 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264493 4557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264594 4557 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264773 4557 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264897 4557 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264946 4557 kubelet.go:493] "Attempting to sync node with API server" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264962 4557 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264973 4557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264982 4557 kubelet.go:405] "Adding apiserver pod source" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.264990 4557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.266235 4557 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.266251 4557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 17:29:28.272440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.266921 4557 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 17:29:28.278652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.278615 4557 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 17:29:28.278652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.278637 4557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 17:29:28.278775 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.278762 4557 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 17:29:28.279021 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279005 4557 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 17:29:28.279087 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279047 4557 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 17:29:28.279156 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279145 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279160 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279166 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279172 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279177 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279183 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279189 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279194 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279201 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 17:29:28.279208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279207 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 17:29:28.279615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279216 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 17:29:28.279615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279225 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 17:29:28.279615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279247 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 17:29:28.279615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.279253 4557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 17:29:28.282940 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.282924 4557 server.go:1263] "Started kubelet" Nov 03 17:29:28.283099 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.283077 4557 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 17:29:28.283176 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.283063 4557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 17:29:28.283176 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.283141 4557 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 17:29:28.283469 ip-10-0-141-130 systemd[1]: Started Kubernetes Kubelet. Nov 03 17:29:28.284518 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.284195 4557 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 17:29:28.284518 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.284477 4557 server.go:317] "Adding debug handlers to kubelet server" Nov 03 17:29:28.286592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.285769 4557 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 17:29:28.286592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.285929 4557 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 17:29:28.286592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.285939 4557 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 17:29:28.286789 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.286614 4557 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-130.us-east-2.compute.internal\" not found" Nov 03 17:29:28.286789 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.286641 4557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 17:29:28.286918 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.286896 4557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 17:29:28.287078 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.287007 4557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:23:49 +0000 UTC" deadline="2028-07-29 23:27:35.666513992 +0000 UTC" Nov 03 17:29:28.287078 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.287064 4557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h58m7.379453454s" Nov 03 17:29:28.287766 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.287682 4557 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288111 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="538f7463-1f30-4039-854b-9be1f87673d0" volumeName="kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288155 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea7d29fb-094a-42e2-ae6b-84c6027dfeaf" volumeName="kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288169 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbcb6a4-1f46-4982-b614-2e838dcf6589" volumeName="kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288184 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6269505c-e5d3-47ee-bb53-0e932ad0782b" volumeName="kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288195 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a24bb641-25bd-48fc-80eb-6e7ed5152327" volumeName="kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288206 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6da9b82-0d11-4c37-899d-cbe95b50213b" volumeName="kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288219 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd497561-3a6d-487c-a9b1-459f9dd47277" volumeName="kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288230 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db4a2814-a7a4-4181-9e07-d433c6ea5e1b" volumeName="kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288243 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbcb6a4-1f46-4982-b614-2e838dcf6589" volumeName="kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288253 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbcb6a4-1f46-4982-b614-2e838dcf6589" volumeName="kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288263 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05c258f2-553a-4da7-875a-4eb12d044178" volumeName="kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288275 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="538f7463-1f30-4039-854b-9be1f87673d0" volumeName="kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288286 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b30fa2c-c31b-48f4-b942-d3a98813859f" volumeName="kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288297 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc01ca73-d0da-40ec-bd7f-abd606f41e93" volumeName="kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288310 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbcb6a4-1f46-4982-b614-2e838dcf6589" volumeName="kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288321 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ece6b52-df4d-42dc-8173-ae1db4516094" volumeName="kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288333 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="538f7463-1f30-4039-854b-9be1f87673d0" volumeName="kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288344 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" volumeName="kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288355 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" volumeName="kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288368 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99b58fa8-fd3b-4836-a82e-4bc7f7948abb" volumeName="kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288377 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a24bb641-25bd-48fc-80eb-6e7ed5152327" volumeName="kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288387 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99b58fa8-fd3b-4836-a82e-4bc7f7948abb" volumeName="kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288397 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abc4e194-5ae1-48cd-9b1b-2168ac647739" volumeName="kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288409 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05c258f2-553a-4da7-875a-4eb12d044178" volumeName="kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288419 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ece6b52-df4d-42dc-8173-ae1db4516094" volumeName="kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288430 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6da9b82-0d11-4c37-899d-cbe95b50213b" volumeName="kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288441 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" volumeName="kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288452 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a24bb641-25bd-48fc-80eb-6e7ed5152327" volumeName="kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288467 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a24bb641-25bd-48fc-80eb-6e7ed5152327" volumeName="kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288478 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ece6b52-df4d-42dc-8173-ae1db4516094" volumeName="kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288488 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6269505c-e5d3-47ee-bb53-0e932ad0782b" volumeName="kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288498 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="75c58a6b-ff67-4ba5-b02f-15054b69a244" volumeName="kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288510 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="75c58a6b-ff67-4ba5-b02f-15054b69a244" volumeName="kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288537 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" volumeName="kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288548 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f0c85c9-5872-471f-890f-e575ed8804da" volumeName="kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288561 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f0c85c9-5872-471f-890f-e575ed8804da" volumeName="kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288659 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f0c85c9-5872-471f-890f-e575ed8804da" volumeName="kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288669 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6269505c-e5d3-47ee-bb53-0e932ad0782b" volumeName="kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288679 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc01ca73-d0da-40ec-bd7f-abd606f41e93" volumeName="kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288689 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="de29fa43-1b3b-4505-9332-468e7d6b196d" volumeName="kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288702 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea7d29fb-094a-42e2-ae6b-84c6027dfeaf" volumeName="kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288712 4557 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbcb6a4-1f46-4982-b614-2e838dcf6589" volumeName="kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config" seLinuxMountContext="" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288724 4557 reconstruct.go:97] "Volume reconstruction finished" Nov 03 17:29:28.288891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.288731 4557 reconciler.go:29] "Reconciler: start to sync state" Nov 03 17:29:28.290690 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.290411 4557 factory.go:55] Registering systemd factory Nov 03 17:29:28.290690 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.290432 4557 factory.go:223] Registration of the systemd container factory successfully Nov 03 17:29:28.291923 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.291154 4557 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:29:28.291923 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.291481 4557 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:29:28.293357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.292494 4557 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 17:29:28.293517 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.293432 4557 factory.go:153] Registering CRI-O factory Nov 03 17:29:28.293517 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.293449 4557 factory.go:223] Registration of the crio container factory successfully Nov 03 17:29:28.293517 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.293501 4557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 17:29:28.293689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.293521 4557 factory.go:103] Registering Raw factory Nov 03 17:29:28.293689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.293534 4557 manager.go:1199] Started watching for new ooms in manager Nov 03 17:29:28.294295 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.294279 4557 manager.go:319] Starting recovery of all containers Nov 03 17:29:28.304959 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.304940 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:28.306410 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.306389 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:28.314359 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.314330 4557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 17:29:28.315490 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.315467 4557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 17:29:28.315613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.315499 4557 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 17:29:28.315613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.315523 4557 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 17:29:28.315613 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.315561 4557 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 17:29:28.320192 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.320169 4557 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 17:29:28.329681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329640 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="01ceaf5f597dbcb168a9b07519eaa9af673c9a1d6623114287a7ef854d569322" exitCode=0 Nov 03 17:29:28.329681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329675 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="a54190b4c5ed2b2c66d9b67ef9c6b0e31467edb91b39acf5d911d49ab067254c" exitCode=0 Nov 03 17:29:28.329681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329683 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="78f78e945bb1e551ec1017720ba016d3191f5857ddeb38774cf0446aa43df614" exitCode=0 Nov 03 17:29:28.329681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329689 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="3992f813b29d679131c049efaa28248779969ba5c6d19165f0068d41fc5b0cd1" exitCode=0 Nov 03 17:29:28.329904 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329694 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="dafa14fd2276fd7ee830bf2c63ab7471512cd8288e32f5e8a05981488d87eda7" exitCode=0 Nov 03 17:29:28.329904 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.329701 4557 generic.go:356] "Generic (PLEG): container finished" podID="a24bb641-25bd-48fc-80eb-6e7ed5152327" containerID="41d7fec6906b2b7739039c4d746a0dbaa77d1c2ae917343d5be57ba71bf702fb" exitCode=0 Nov 03 17:29:28.343429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.343408 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:29:28.343768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.343745 4557 generic.go:356] "Generic (PLEG): container finished" podID="fbbcb6a4-1f46-4982-b614-2e838dcf6589" containerID="50d85b9a034effaeb9e41268f355a5c5acb2a687883c51a95452a182b020f18e" exitCode=1 Nov 03 17:29:28.348630 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.348546 4557 generic.go:356] "Generic (PLEG): container finished" podID="1d6d5118fb6c640821cbaa8f5802c9ee" containerID="5cc527798a1e1251406b4b8a8ff70a12f8a1479040c1845a697784744eee4a9b" exitCode=0 Nov 03 17:29:28.364334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.364316 4557 manager.go:324] Recovery completed Nov 03 17:29:28.378835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378813 4557 cpu_manager.go:226] "Starting" policy="none" Nov 03 17:29:28.378835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378828 4557 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 17:29:28.378950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378844 4557 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 17:29:28.378979 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378953 4557 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 17:29:28.378979 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378964 4557 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 17:29:28.379041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378981 4557 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 17:29:28.379041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378989 4557 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 17:29:28.379041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.378996 4557 policy_none.go:50] "Start" Nov 03 17:29:28.379041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.379005 4557 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 17:29:28.379041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.379014 4557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 17:29:28.379168 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.379138 4557 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 17:29:28.379168 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.379145 4557 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 17:29:28.379168 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.379151 4557 policy_none.go:44] "Start" Nov 03 17:29:28.383548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.383017 4557 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 17:29:28.388278 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388260 4557 manager.go:341] "Starting Device Plugin manager" Nov 03 17:29:28.388366 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.388285 4557 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 17:29:28.388366 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388293 4557 server.go:87] "Starting device plugin registration server" Nov 03 17:29:28.388528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388517 4557 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 17:29:28.388586 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388529 4557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 17:29:28.388705 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388657 4557 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 17:29:28.388777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388749 4557 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 17:29:28.388843 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388786 4557 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 17:29:28.388843 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388792 4557 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 17:29:28.388965 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.388843 4557 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T17:29:28.388775824Z","UUID":"a8056987-d16c-4d57-b799-574eb8451ed6","Handler":null,"Name":"","Endpoint":""} Nov 03 17:29:28.390160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.390145 4557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 17:29:28.390252 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.390168 4557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 17:29:28.390630 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.390612 4557 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 17:29:28.415944 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.415904 4557 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal"] Nov 03 17:29:28.416502 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416486 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.416581 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416494 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"dfd3375087b535eb1ba3fbe0bafa7b69","Type":"ContainerStarted","Data":"4da8b8884a3a9431c1532b3aa7fe13fe2261e5b3d4329f9eb99343ec75c31f05"} Nov 03 17:29:28.416624 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416592 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"dfd3375087b535eb1ba3fbe0bafa7b69","Type":"ContainerStarted","Data":"60e9bea68a05d3a75ffaa450e878079196efcaa1d7b32c57caa5f6d414b82e3c"} Nov 03 17:29:28.416624 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416613 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerStarted","Data":"2aa1793a8654b42246a81250924e82f1a0564ee6538164a005680b7975a636e3"} Nov 03 17:29:28.416710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416634 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerDied","Data":"5cc527798a1e1251406b4b8a8ff70a12f8a1479040c1845a697784744eee4a9b"} Nov 03 17:29:28.416710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416653 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" event={"ID":"1d6d5118fb6c640821cbaa8f5802c9ee","Type":"ContainerStarted","Data":"c9e13efb87ca48da25bc8707f432101e75f28093ec6eed016dcb4fd311a908c9"} Nov 03 17:29:28.416810 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.416795 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.430997 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.430975 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:29:28.431100 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.431019 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.431919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.431897 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:29:28.432007 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:28.431938 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.490227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.490192 4557 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 17:29:28.491449 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.491432 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 17:29:28.491542 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.491467 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 17:29:28.491542 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.491483 4557 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-130.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 17:29:28.491542 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.491525 4557 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.493647 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.493616 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.493712 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.493654 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.493712 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.493671 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.525161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.525135 4557 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.525243 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.525201 4557 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594258 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594269 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594327 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594352 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594403 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d6d5118fb6c640821cbaa8f5802c9ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"1d6d5118fb6c640821cbaa8f5802c9ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:28.594527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:28.594433 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfd3375087b535eb1ba3fbe0bafa7b69-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" (UID: \"dfd3375087b535eb1ba3fbe0bafa7b69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:29.265886 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.265853 4557 apiserver.go:52] "Watching apiserver" Nov 03 17:29:29.275733 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.275705 4557 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 17:29:29.276543 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.276511 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9zk8s","openshift-multus/network-metrics-daemon-c4sp7","openshift-dns/dns-default-c5rrv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp","openshift-image-registry/node-ca-l8ftc","openshift-ovn-kubernetes/ovnkube-node-slpkv","openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal","openshift-ingress-canary/ingress-canary-wznnr","openshift-insights/periodic-gathering-vtgkc-jzwjk","openshift-network-operator/iptables-alerter-nkxl4","openshift-multus/multus-xrhqr","openshift-insights/insights-runtime-extractor-6jcf5","kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-8pmql","openshift-multus/multus-additional-cni-plugins-wfd8s","kube-system/global-pull-secret-syncer-j72rg","kube-system/konnectivity-agent-rzndd","openshift-network-diagnostics/network-check-target-ld2j9","openshift-service-ca/service-ca-5fffc97bdf-gxqhh"] Nov 03 17:29:29.282432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.282412 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.283388 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.283370 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.283803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.283790 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.288152 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.288136 4557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 17:29:29.295679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.295662 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.297294 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297270 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.297394 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297298 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.297394 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297317 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.297394 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297335 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.297520 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297394 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297520 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297432 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297520 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297472 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297507 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297551 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.297691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297614 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.297691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297663 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:29.297691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297690 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297713 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297740 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvg4m\" (UniqueName: \"kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m\") pod \"migrator-66df5d496b-rbgxz\" (UID: \"abc4e194-5ae1-48cd-9b1b-2168ac647739\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297772 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297836 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297863 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297880 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxlg\" (UniqueName: \"kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.297917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297912 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtmz\" (UniqueName: \"kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.297990 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298016 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298048 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-tuned\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298060 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298088 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6b5n\" (UniqueName: \"kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298105 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rsb\" (UniqueName: \"kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298139 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298164 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298195 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298220 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298249 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78cz\" (UniqueName: \"kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298273 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298291 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.298331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298310 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298360 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298407 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298463 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298530 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6269505c-e5d3-47ee-bb53-0e932ad0782b-tmp-dir\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298556 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-data-volume\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298558 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44hk\" (UniqueName: \"kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298628 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-762g7\" (UniqueName: \"kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298683 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.298721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298710 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298737 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298790 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdq27\" (UniqueName: \"kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298865 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298872 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ece6b52-df4d-42dc-8173-ae1db4516094-tmp\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298904 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298938 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nggt\" (UniqueName: \"kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.299027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.298969 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299038 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299072 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299111 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9wp\" (UniqueName: \"kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299137 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299164 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.299350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299329 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv74m\" (UniqueName: \"kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299364 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299383 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299403 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299424 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299455 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299456 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299472 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299508 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299556 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299605 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.299634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299625 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299655 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299702 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299724 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5srq4\" (UniqueName: \"kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299762 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299798 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299823 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299863 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299902 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.299927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299921 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299963 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.299995 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300021 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300043 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300066 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300085 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksg28\" (UniqueName: \"kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300100 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300140 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300168 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300189 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300213 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300242 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300262 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300277 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300320 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300362 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300380 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300396 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300415 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300461 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300480 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300496 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300501 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-tmp-dir\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300527 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300590 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300626 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300649 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.300678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300672 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:29.301076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300692 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.301076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300707 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.301076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.300729 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.305296 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305263 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 17:29:29.305635 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305613 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4s9f9\"" Nov 03 17:29:29.305712 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305667 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.305712 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305658 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4fnz\"" Nov 03 17:29:29.305801 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305728 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 17:29:29.305801 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305754 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 17:29:29.305801 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305776 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.305924 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305802 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 17:29:29.305924 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305790 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 03 17:29:29.305924 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305901 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.306008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305957 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 17:29:29.306008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.305978 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.307049 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307034 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.307094 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307035 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.307138 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307090 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 17:29:29.307218 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307167 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sqcgc\"" Nov 03 17:29:29.307273 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307236 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvjzb\"" Nov 03 17:29:29.307273 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307249 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.307273 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307204 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 17:29:29.307421 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307279 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-r6gv4\"" Nov 03 17:29:29.307421 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307353 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-t8dmr\"" Nov 03 17:29:29.307535 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307518 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h22mh\"" Nov 03 17:29:29.307621 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307602 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 03 17:29:29.307752 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307734 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 17:29:29.307823 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307770 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ht62h\"" Nov 03 17:29:29.307823 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307812 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 17:29:29.307952 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307935 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 17:29:29.308015 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.307973 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s8vnj\"" Nov 03 17:29:29.308365 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.308345 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-459lb\"" Nov 03 17:29:29.308598 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.308553 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.308833 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.308810 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.308968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.308949 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnwnb\"" Nov 03 17:29:29.309053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.308957 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.309281 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309261 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55x7c\"" Nov 03 17:29:29.309520 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309490 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05c258f2-553a-4da7-875a-4eb12d044178-konnectivity-ca\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:29.309608 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309390 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8nzjt\"" Nov 03 17:29:29.309748 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309718 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.309830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309744 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.309830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.309802 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc01ca73-d0da-40ec-bd7f-abd606f41e93-cert\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:29.310042 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310024 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 17:29:29.310116 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310102 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-592l9\"" Nov 03 17:29:29.310303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310255 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.310406 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310265 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.310406 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310382 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 17:29:29.310511 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310488 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.310601 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310586 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5jpwh\"" Nov 03 17:29:29.310857 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310831 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 17:29:29.311002 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310869 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.311002 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310933 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-config\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.311002 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.310971 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 17:29:29.311233 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.311108 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.311233 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.311218 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-crwt4\"" Nov 03 17:29:29.311411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.311387 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 17:29:29.311486 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.311407 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 17:29:29.311984 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.311965 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f0c85c9-5872-471f-890f-e575ed8804da-signing-key\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.312135 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312114 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6269505c-e5d3-47ee-bb53-0e932ad0782b-config-volume\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.312377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312332 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovn-node-metrics-cert\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.313493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312448 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05c258f2-553a-4da7-875a-4eb12d044178-agent-certs\") pod \"konnectivity-agent-rzndd\" (UID: \"05c258f2-553a-4da7-875a-4eb12d044178\") " pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:29.313493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313490 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313502 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312479 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6da9b82-0d11-4c37-899d-cbe95b50213b-serviceca\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312823 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312755 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312688 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-original-pull-secret\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313165 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.313662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313106 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.314007 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.312868 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 17:29:29.314007 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313366 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mh8gc\"" Nov 03 17:29:29.314007 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313425 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 03 17:29:29.314007 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313368 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.314007 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.313976 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 17:29:29.314212 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.314028 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 03 17:29:29.314212 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.314140 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-jdtg9\"" Nov 03 17:29:29.314286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.314199 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 17:29:29.314286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.314207 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 17:29:29.314380 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.314326 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 03 17:29:29.318193 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.318177 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-env-overrides\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.318303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.318283 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f0c85c9-5872-471f-890f-e575ed8804da-signing-cabundle\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.318455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.318443 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbbcb6a4-1f46-4982-b614-2e838dcf6589-ovnkube-script-lib\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.319016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.319002 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtmz\" (UniqueName: \"kubernetes.io/projected/c6da9b82-0d11-4c37-899d-cbe95b50213b-kube-api-access-wvtmz\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.319772 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.319753 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.319859 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.319789 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a24bb641-25bd-48fc-80eb-6e7ed5152327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320056 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-cni-binary-copy\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320136 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/538f7463-1f30-4039-854b-9be1f87673d0-multus-daemon-config\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320667 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-762g7\" (UniqueName: \"kubernetes.io/projected/a24bb641-25bd-48fc-80eb-6e7ed5152327-kube-api-access-762g7\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320673 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320703 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9wp\" (UniqueName: \"kubernetes.io/projected/538f7463-1f30-4039-854b-9be1f87673d0-kube-api-access-qg9wp\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320728 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv74m\" (UniqueName: \"kubernetes.io/projected/6269505c-e5d3-47ee-bb53-0e932ad0782b-kube-api-access-xv74m\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.320782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320753 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxlg\" (UniqueName: \"kubernetes.io/projected/fbbcb6a4-1f46-4982-b614-2e838dcf6589-kube-api-access-6jxlg\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.321059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320799 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"periodic-gathering-vtgkc-jzwjk\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:29:29.321059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320800 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdq27\" (UniqueName: \"kubernetes.io/projected/dc01ca73-d0da-40ec-bd7f-abd606f41e93-kube-api-access-rdq27\") pod \"ingress-canary-wznnr\" (UID: \"dc01ca73-d0da-40ec-bd7f-abd606f41e93\") " pod="openshift-ingress-canary/ingress-canary-wznnr" Nov 03 17:29:29.321059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320858 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nggt\" (UniqueName: \"kubernetes.io/projected/cd497561-3a6d-487c-a9b1-459f9dd47277-kube-api-access-7nggt\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.321059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.320874 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75c58a6b-ff67-4ba5-b02f-15054b69a244-iptables-alerter-script\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.323899 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.323883 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvg4m\" (UniqueName: \"kubernetes.io/projected/abc4e194-5ae1-48cd-9b1b-2168ac647739-kube-api-access-rvg4m\") pod \"migrator-66df5d496b-rbgxz\" (UID: \"abc4e194-5ae1-48cd-9b1b-2168ac647739\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rbgxz" Nov 03 17:29:29.324229 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.324212 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndxvj\" (UniqueName: \"kubernetes.io/projected/de29fa43-1b3b-4505-9332-468e7d6b196d-kube-api-access-ndxvj\") pod \"network-check-target-ld2j9\" (UID: \"de29fa43-1b3b-4505-9332-468e7d6b196d\") " pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:29.324996 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.324971 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5srq4\" (UniqueName: \"kubernetes.io/projected/3f0c85c9-5872-471f-890f-e575ed8804da-kube-api-access-5srq4\") pod \"service-ca-5fffc97bdf-gxqhh\" (UID: \"3f0c85c9-5872-471f-890f-e575ed8804da\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" Nov 03 17:29:29.325098 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.324997 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksg28\" (UniqueName: \"kubernetes.io/projected/4ece6b52-df4d-42dc-8173-ae1db4516094-kube-api-access-ksg28\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.325174 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.325108 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44hk\" (UniqueName: \"kubernetes.io/projected/5b30fa2c-c31b-48f4-b942-d3a98813859f-kube-api-access-x44hk\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.325230 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.325188 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78cz\" (UniqueName: \"kubernetes.io/projected/75c58a6b-ff67-4ba5-b02f-15054b69a244-kube-api-access-n78cz\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.325280 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.325261 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6b5n\" (UniqueName: \"kubernetes.io/projected/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-api-access-z6b5n\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.325432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.325416 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rsb\" (UniqueName: \"kubernetes.io/projected/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-kube-api-access-86rsb\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.357096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.357071 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:29.357257 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.357154 4557 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:29.370555 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.370535 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:29:29.370694 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.370586 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:29.371283 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.371268 4557 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 17:29:29.371354 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.371296 4557 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.us-east-2.compute.internal" Nov 03 17:29:29.401070 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401041 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401070 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401070 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401087 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401112 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401134 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401144 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-netns\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401165 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401167 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-bin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401187 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401202 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-systemd\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401223 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401243 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-modprobe-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401226 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-device-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401262 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401250 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401280 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-conf\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401297 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401305 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysconfig\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401315 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-lib-modules\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401326 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401350 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401371 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401383 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-var-lib-kubelet\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401405 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401423 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401429 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea7d29fb-094a-42e2-ae6b-84c6027dfeaf-hosts-file\") pod \"node-resolver-9zk8s\" (UID: \"ea7d29fb-094a-42e2-ae6b-84c6027dfeaf\") " pod="openshift-dns/node-resolver-9zk8s" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401440 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401442 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-bin\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401462 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401465 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c58a6b-ff67-4ba5-b02f-15054b69a244-host-slash\") pod \"iptables-alerter-nkxl4\" (UID: \"75c58a6b-ff67-4ba5-b02f-15054b69a244\") " pod="openshift-network-operator/iptables-alerter-nkxl4" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401473 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-registration-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401484 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-slash\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401508 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-etc-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401534 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401553 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401587 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401590 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401607 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401632 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-kubelet\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401631 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401661 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401672 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401679 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401720 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-ovn\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401729 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401749 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-crio-socket\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.401720 4557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401771 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401777 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-run\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401781 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-sysctl-d\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401794 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401822 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401829 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-kubelet-config\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401842 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db4a2814-a7a4-4181-9e07-d433c6ea5e1b-dbus\") pod \"global-pull-secret-syncer-j72rg\" (UID: \"db4a2814-a7a4-4181-9e07-d433c6ea5e1b\") " pod="kube-system/global-pull-secret-syncer-j72rg" Nov 03 17:29:29.401830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401844 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401883 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401891 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.401890 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:29.90187128 +0000 UTC m=+1.738984098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.401893 4557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401917 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401939 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6da9b82-0d11-4c37-899d-cbe95b50213b-host\") pod \"node-ca-l8ftc\" (UID: \"c6da9b82-0d11-4c37-899d-cbe95b50213b\") " pod="openshift-image-registry/node-ca-l8ftc" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401944 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.401964 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:29.90194522 +0000 UTC m=+1.739058031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : secret "metrics-daemon-secret" not found Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401981 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-etc-kubernetes\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.401992 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402008 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402031 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402053 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402068 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402083 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402089 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-kubelet\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402099 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402105 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-conf-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402127 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-systemd-units\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402134 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402128 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-log-socket\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402099 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-systemd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402159 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402177 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402182 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-k8s-cni-cncf-io\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402147 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-cnibin\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402199 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402222 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402227 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-hostroot\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402240 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402248 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-var-lib-cni-multus\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402254 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402268 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402156 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-ovn-kubernetes\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402275 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402299 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-sys\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402307 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-host\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402312 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-socket-dir\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402190 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-multus-socket-dir-parent\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402313 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402341 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-var-lib-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402355 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402380 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402398 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-run-openvswitch\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402404 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402417 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-node-log\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402424 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-host-run-multus-certs\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402428 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402455 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402460 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ece6b52-df4d-42dc-8173-ae1db4516094-etc-kubernetes\") pod \"tuned-8pmql\" (UID: \"4ece6b52-df4d-42dc-8173-ae1db4516094\") " pod="openshift-cluster-node-tuning-operator/tuned-8pmql" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402492 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-system-cni-dir\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402506 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402535 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402553 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a24bb641-25bd-48fc-80eb-6e7ed5152327-cnibin\") pod \"multus-additional-cni-plugins-wfd8s\" (UID: \"a24bb641-25bd-48fc-80eb-6e7ed5152327\") " pod="openshift-multus/multus-additional-cni-plugins-wfd8s" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402559 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402587 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-run-netns\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402604 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402637 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbbcb6a4-1f46-4982-b614-2e838dcf6589-host-cni-netd\") pod \"ovnkube-node-slpkv\" (UID: \"fbbcb6a4-1f46-4982-b614-2e838dcf6589\") " pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402657 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/538f7463-1f30-4039-854b-9be1f87673d0-system-cni-dir\") pod \"multus-xrhqr\" (UID: \"538f7463-1f30-4039-854b-9be1f87673d0\") " pod="openshift-multus/multus-xrhqr" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402656 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402689 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd497561-3a6d-487c-a9b1-459f9dd47277-sys-fs\") pod \"aws-ebs-csi-driver-node-lbdmp\" (UID: \"cd497561-3a6d-487c-a9b1-459f9dd47277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbdmp" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.402697 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.402788 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:29.403317 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.402860 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:29.902845724 +0000 UTC m=+1.739958541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:29.422419 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.422393 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zk8s_ea7d29fb-094a-42e2-ae6b-84c6027dfeaf/dns-node-resolver/0.log" Nov 03 17:29:29.586412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.586392 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:29:29.905882 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.905799 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:29.905882 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.905860 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:29.906062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:29.905901 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:29.906062 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.905975 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:29.906062 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.906011 4557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:29.906062 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.906036 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:30.906021481 +0000 UTC m=+2.743134283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:29.906197 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.906060 4557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 17:29:29.906197 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.906080 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:30.906064246 +0000 UTC m=+2.743177065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:29.906197 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:29.906108 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:30.906098253 +0000 UTC m=+2.743211063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : secret "metrics-daemon-secret" not found Nov 03 17:29:30.364958 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.364917 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-gxqhh" event={"ID":"3f0c85c9-5872-471f-890f-e575ed8804da","Type":"ContainerStarted","Data":"a5c9c6c43c56d639a4186c8f68008221c98d6c03035a1ac7a22f6bdc6352f697"} Nov 03 17:29:30.422351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.422324 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8ftc_c6da9b82-0d11-4c37-899d-cbe95b50213b/node-ca/0.log" Nov 03 17:29:30.484733 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.484654 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:29:30.915620 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.915585 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:30.915784 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.915629 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:30.915784 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:30.915675 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:30.915784 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915757 4557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:30.915784 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915771 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:30.915944 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915825 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:32.915807939 +0000 UTC m=+4.752920757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:30.915944 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915840 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:32.915832428 +0000 UTC m=+4.752945245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:30.915944 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915885 4557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 17:29:30.915944 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:30.915914 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs podName:5b30fa2c-c31b-48f4-b942-d3a98813859f nodeName:}" failed. No retries permitted until 2026-11-03 17:29:32.915904834 +0000 UTC m=+4.753017652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs") pod "network-metrics-daemon-c4sp7" (UID: "5b30fa2c-c31b-48f4-b942-d3a98813859f") : secret "metrics-daemon-secret" not found Nov 03 17:29:31.618822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:31.618794 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wznnr_dc01ca73-d0da-40ec-bd7f-abd606f41e93/serve-healthcheck-canary/0.log" Nov 03 17:29:32.933496 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:32.933458 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:32.933895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:32.933516 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:32.933895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:32.933677 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:32.933895 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:32.933793 4557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 17:29:32.933895 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:32.933854 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls podName:99b58fa8-fd3b-4836-a82e-4bc7f7948abb nodeName:}" failed. No retries permitted until 2026-11-03 17:29:36.933840706 +0000 UTC m=+8.770953508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jcf5" (UID: "99b58fa8-fd3b-4836-a82e-4bc7f7948abb") : secret "insights-runtime-extractor-tls" not found Nov 03 17:29:32.933895 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:32.933792 4557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:32.934091 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:32.933924 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:36.933913356 +0000 UTC m=+8.771026158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:32.934091 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:32.933993 4557 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 17:29:32.936097 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:32.936078 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b30fa2c-c31b-48f4-b942-d3a98813859f-metrics-certs\") pod \"network-metrics-daemon-c4sp7\" (UID: \"5b30fa2c-c31b-48f4-b942-d3a98813859f\") " pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:33.183231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:33.183194 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4sp7" Nov 03 17:29:33.468592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:33.468496 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4sp7"] Nov 03 17:29:33.472481 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:33.472450 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b30fa2c_c31b_48f4_b942_d3a98813859f.slice/crio-1de0ba5410aa4d65c232717f6920151932580ba6bb23ec40af90acca5e239431 WatchSource:0}: Error finding container 1de0ba5410aa4d65c232717f6920151932580ba6bb23ec40af90acca5e239431: Status 404 returned error can't find the container with id 1de0ba5410aa4d65c232717f6920151932580ba6bb23ec40af90acca5e239431 Nov 03 17:29:34.084928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:34.084891 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:34.378024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:34.378000 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4sp7" event={"ID":"5b30fa2c-c31b-48f4-b942-d3a98813859f","Type":"ContainerStarted","Data":"1de0ba5410aa4d65c232717f6920151932580ba6bb23ec40af90acca5e239431"} Nov 03 17:29:35.383481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:35.383448 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4sp7" event={"ID":"5b30fa2c-c31b-48f4-b942-d3a98813859f","Type":"ContainerStarted","Data":"bd49a5426e05aeea5c32905a39c329962353f208a35ed370d06c583cd8ff5ffa"} Nov 03 17:29:35.383980 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:35.383503 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4sp7" event={"ID":"5b30fa2c-c31b-48f4-b942-d3a98813859f","Type":"ContainerStarted","Data":"394f0deb999b17f101f5921182fc0b20bc723f4f78b40913d7c25e3d72bb6e78"} Nov 03 17:29:36.958360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:36.958322 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:36.958787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:36.958381 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:36.958787 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:36.958465 4557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 17:29:36.958787 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:36.958528 4557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls podName:6269505c-e5d3-47ee-bb53-0e932ad0782b nodeName:}" failed. No retries permitted until 2026-11-03 17:29:44.958514892 +0000 UTC m=+16.795627695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls") pod "dns-default-c5rrv" (UID: "6269505c-e5d3-47ee-bb53-0e932ad0782b") : secret "dns-default-metrics-tls" not found Nov 03 17:29:36.960619 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:36.960598 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99b58fa8-fd3b-4836-a82e-4bc7f7948abb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jcf5\" (UID: \"99b58fa8-fd3b-4836-a82e-4bc7f7948abb\") " pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:37.084904 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:37.084869 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jcf5" Nov 03 17:29:37.359714 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:37.359627 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jcf5"] Nov 03 17:29:37.362702 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:37.362671 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b58fa8_fd3b_4836_a82e_4bc7f7948abb.slice/crio-2f46176d95abc9eff59455061c91cc32f14cd2730124ec603088a2c1639ce6fe WatchSource:0}: Error finding container 2f46176d95abc9eff59455061c91cc32f14cd2730124ec603088a2c1639ce6fe: Status 404 returned error can't find the container with id 2f46176d95abc9eff59455061c91cc32f14cd2730124ec603088a2c1639ce6fe Nov 03 17:29:37.391234 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:37.391202 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jcf5" event={"ID":"99b58fa8-fd3b-4836-a82e-4bc7f7948abb","Type":"ContainerStarted","Data":"2f46176d95abc9eff59455061c91cc32f14cd2730124ec603088a2c1639ce6fe"} Nov 03 17:29:37.569964 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:37.569935 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:37.570188 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:37.570173 4557 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 17:29:38.395874 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:38.395825 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jcf5" event={"ID":"99b58fa8-fd3b-4836-a82e-4bc7f7948abb","Type":"ContainerStarted","Data":"f7d735cd46cb46032fde47b8ac4b9f9b247f619d063bc22fd67f4f1eba277d28"} Nov 03 17:29:38.396322 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:38.395888 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jcf5" event={"ID":"99b58fa8-fd3b-4836-a82e-4bc7f7948abb","Type":"ContainerStarted","Data":"2fb15ab45581f05fad3936663530e350d0cc7cba952d84870e6e56a181712058"} Nov 03 17:29:38.729079 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:38.729045 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slpkv" Nov 03 17:29:40.405011 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:40.404974 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jcf5" event={"ID":"99b58fa8-fd3b-4836-a82e-4bc7f7948abb","Type":"ContainerStarted","Data":"629d11f0d9435db555cde2f4053272b1c3b5a4a1796e7fdbcc7256a72c2d0eba"} Nov 03 17:29:45.014423 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:45.014382 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:45.016729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:45.016708 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6269505c-e5d3-47ee-bb53-0e932ad0782b-metrics-tls\") pod \"dns-default-c5rrv\" (UID: \"6269505c-e5d3-47ee-bb53-0e932ad0782b\") " pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:45.184204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:45.184167 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:45.456207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:45.456175 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5rrv"] Nov 03 17:29:45.458544 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:45.458518 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6269505c_e5d3_47ee_bb53_0e932ad0782b.slice/crio-f6b61d76b72b0105510a9e0baac73bd3ae83f20b3cf23b98da8a4ec95f00c4a1 WatchSource:0}: Error finding container f6b61d76b72b0105510a9e0baac73bd3ae83f20b3cf23b98da8a4ec95f00c4a1: Status 404 returned error can't find the container with id f6b61d76b72b0105510a9e0baac73bd3ae83f20b3cf23b98da8a4ec95f00c4a1 Nov 03 17:29:46.425845 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:46.425806 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5rrv" event={"ID":"6269505c-e5d3-47ee-bb53-0e932ad0782b","Type":"ContainerStarted","Data":"f6b61d76b72b0105510a9e0baac73bd3ae83f20b3cf23b98da8a4ec95f00c4a1"} Nov 03 17:29:46.693128 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:46.693057 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rzndd" Nov 03 17:29:47.431077 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:47.431040 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5rrv" event={"ID":"6269505c-e5d3-47ee-bb53-0e932ad0782b","Type":"ContainerStarted","Data":"c26784b7e3f133268c7e2898b43eac6bd1800de7120ecb1df6ee2f63e4bbdc4d"} Nov 03 17:29:47.431594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:47.431131 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5rrv" event={"ID":"6269505c-e5d3-47ee-bb53-0e932ad0782b","Type":"ContainerStarted","Data":"10a43c1e392d6f5d16f4c6dbc246991ed200bc94165955fa8bf56abd2cb22bdd"} Nov 03 17:29:47.431594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:47.431181 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:49.413952 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:29:49.413917 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:29:50.147906 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.147876 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-674c8fbb7b-52jb7"] Nov 03 17:29:50.150272 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.150232 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.172615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.172583 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 03 17:29:50.179903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.179877 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674c8fbb7b-52jb7"] Nov 03 17:29:50.194428 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.194402 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 03 17:29:50.194790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.194762 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h9hqq\"" Nov 03 17:29:50.194790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.194773 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 03 17:29:50.195014 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.194865 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 03 17:29:50.246938 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.246905 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-tls\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.246938 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.246937 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-installation-pull-secrets\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247173 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.246960 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-bound-sa-token\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247173 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.247022 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-image-registry-private-configuration\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247173 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.247137 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8b4fa8f-6c62-4c77-b42d-58997ed66901-ca-trust-extracted\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.247171 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-certificates\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.247260 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-trusted-ca\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.247303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.247283 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hss\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-kube-api-access-z5hss\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348330 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-trusted-ca\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348363 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hss\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-kube-api-access-z5hss\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348385 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-tls\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348494 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-installation-pull-secrets\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348537 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-bound-sa-token\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348611 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-image-registry-private-configuration\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348639 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8b4fa8f-6c62-4c77-b42d-58997ed66901-ca-trust-extracted\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.348848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.348664 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-certificates\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.349267 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.349203 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8b4fa8f-6c62-4c77-b42d-58997ed66901-ca-trust-extracted\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.349519 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.349498 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-trusted-ca\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.349607 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.349589 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-certificates\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.351099 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.351075 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-registry-tls\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.351328 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.351312 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-image-registry-private-configuration\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.351481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.351451 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8b4fa8f-6c62-4c77-b42d-58997ed66901-installation-pull-secrets\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.361148 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.361126 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-bound-sa-token\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.361234 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.361190 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hss\" (UniqueName: \"kubernetes.io/projected/a8b4fa8f-6c62-4c77-b42d-58997ed66901-kube-api-access-z5hss\") pod \"image-registry-674c8fbb7b-52jb7\" (UID: \"a8b4fa8f-6c62-4c77-b42d-58997ed66901\") " pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.462749 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.462722 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:50.738011 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:50.737932 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674c8fbb7b-52jb7"] Nov 03 17:29:50.740540 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:50.740517 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b4fa8f_6c62_4c77_b42d_58997ed66901.slice/crio-e499a3f66f57d971b75f1f8b8ab3f4577058cd14c8314a2eb2cb0f72bf23ae12 WatchSource:0}: Error finding container e499a3f66f57d971b75f1f8b8ab3f4577058cd14c8314a2eb2cb0f72bf23ae12: Status 404 returned error can't find the container with id e499a3f66f57d971b75f1f8b8ab3f4577058cd14c8314a2eb2cb0f72bf23ae12 Nov 03 17:29:51.444272 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:51.444239 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" event={"ID":"a8b4fa8f-6c62-4c77-b42d-58997ed66901","Type":"ContainerStarted","Data":"e101fb13528062bb60e5d7a1f69f6148210da80be4bbb0db64857ae3b63e0ff0"} Nov 03 17:29:51.444453 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:51.444286 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" event={"ID":"a8b4fa8f-6c62-4c77-b42d-58997ed66901","Type":"ContainerStarted","Data":"e499a3f66f57d971b75f1f8b8ab3f4577058cd14c8314a2eb2cb0f72bf23ae12"} Nov 03 17:29:51.444453 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:51.444391 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:29:51.470739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:51.470687 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" podStartSLOduration=1.4706721919999999 podStartE2EDuration="1.470672192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:51.469012421 +0000 UTC m=+23.306125244" watchObservedRunningTime="2026-11-03 17:29:51.470672192 +0000 UTC m=+23.307785007" Nov 03 17:29:57.437160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.437123 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c5rrv" Nov 03 17:29:57.509822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.509795 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c"] Nov 03 17:29:57.538987 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.538941 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c"] Nov 03 17:29:57.539699 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.539678 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brrzg"] Nov 03 17:29:57.540404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.539497 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.556648 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.556629 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.598433 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.598401 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.598592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.598445 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbnr\" (UniqueName: \"kubernetes.io/projected/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-kube-api-access-clbnr\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.598592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.598552 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.598675 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.598643 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.620357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620323 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 17:29:57.620357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620330 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 03 17:29:57.620634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620619 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 17:29:57.620713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620642 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j9s74\"" Nov 03 17:29:57.620713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620649 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 03 17:29:57.620713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.620700 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8lkxv\"" Nov 03 17:29:57.625273 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.625257 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 17:29:57.625377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.625354 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 17:29:57.625415 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.625396 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 17:29:57.625446 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.625432 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 17:29:57.699935 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.699841 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-textfile\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.699935 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.699886 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbnr\" (UniqueName: \"kubernetes.io/projected/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-kube-api-access-clbnr\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.699935 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.699914 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.699991 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-root\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700037 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-metrics-client-ca\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700069 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.700308 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700219 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-tls\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700308 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700292 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700338 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.700405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700363 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzgr\" (UniqueName: \"kubernetes.io/projected/190d67b2-f12d-45e3-8743-cd793696d19d-kube-api-access-sxzgr\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700511 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700422 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-sys\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700511 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700438 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-wtmp\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.700511 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700468 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.700998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.700953 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.702770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.702751 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.702856 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.702836 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.713726 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.713701 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbnr\" (UniqueName: \"kubernetes.io/projected/2caff5b7-abb0-4c7d-8e95-e830602cdbd6-kube-api-access-clbnr\") pod \"openshift-state-metrics-7bd7489957-2md9c\" (UID: \"2caff5b7-abb0-4c7d-8e95-e830602cdbd6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.801202 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801160 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-textfile\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801202 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801203 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801229 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-root\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801249 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-metrics-client-ca\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801271 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-tls\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801290 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801323 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzgr\" (UniqueName: \"kubernetes.io/projected/190d67b2-f12d-45e3-8743-cd793696d19d-kube-api-access-sxzgr\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801322 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-root\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801341 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-sys\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801359 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-wtmp\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801426 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-sys\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801851 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801518 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-wtmp\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.801851 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.801654 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-textfile\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.802066 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.802042 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-metrics-client-ca\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.802114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.802042 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.803690 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.803668 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-tls\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.803735 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.803715 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190d67b2-f12d-45e3-8743-cd793696d19d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.813561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.813538 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzgr\" (UniqueName: \"kubernetes.io/projected/190d67b2-f12d-45e3-8743-cd793696d19d-kube-api-access-sxzgr\") pod \"node-exporter-brrzg\" (UID: \"190d67b2-f12d-45e3-8743-cd793696d19d\") " pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.889341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.889298 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" Nov 03 17:29:57.927639 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:57.927599 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brrzg" Nov 03 17:29:57.962288 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:57.962259 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190d67b2_f12d_45e3_8743_cd793696d19d.slice/crio-6d37670c903fa1c3260abb5fee9252baddc0dc273c737f850dbbf1215e58f62a WatchSource:0}: Error finding container 6d37670c903fa1c3260abb5fee9252baddc0dc273c737f850dbbf1215e58f62a: Status 404 returned error can't find the container with id 6d37670c903fa1c3260abb5fee9252baddc0dc273c737f850dbbf1215e58f62a Nov 03 17:29:58.202994 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:58.202961 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c"] Nov 03 17:29:58.206061 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:29:58.206030 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caff5b7_abb0_4c7d_8e95_e830602cdbd6.slice/crio-1c6be5b871efa59be0f26cd2446d6da8003ae5fa84190a88b5b530fb842e24de WatchSource:0}: Error finding container 1c6be5b871efa59be0f26cd2446d6da8003ae5fa84190a88b5b530fb842e24de: Status 404 returned error can't find the container with id 1c6be5b871efa59be0f26cd2446d6da8003ae5fa84190a88b5b530fb842e24de Nov 03 17:29:58.469818 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:58.469732 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brrzg" event={"ID":"190d67b2-f12d-45e3-8743-cd793696d19d","Type":"ContainerStarted","Data":"6d37670c903fa1c3260abb5fee9252baddc0dc273c737f850dbbf1215e58f62a"} Nov 03 17:29:58.471822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:58.471792 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" event={"ID":"2caff5b7-abb0-4c7d-8e95-e830602cdbd6","Type":"ContainerStarted","Data":"990e3ce3a354a2966dc92866e15038ead165d61b08a9154ec3596064743e21cc"} Nov 03 17:29:58.471956 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:58.471854 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" event={"ID":"2caff5b7-abb0-4c7d-8e95-e830602cdbd6","Type":"ContainerStarted","Data":"b5559a44c0370052241f02c2cc8102e5c7f6ce33a642dd328c8b5f5023e3fda0"} Nov 03 17:29:58.471956 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:29:58.471886 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" event={"ID":"2caff5b7-abb0-4c7d-8e95-e830602cdbd6","Type":"ContainerStarted","Data":"1c6be5b871efa59be0f26cd2446d6da8003ae5fa84190a88b5b530fb842e24de"} Nov 03 17:30:00.481055 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:00.481021 4557 generic.go:356] "Generic (PLEG): container finished" podID="190d67b2-f12d-45e3-8743-cd793696d19d" containerID="4f9f48111ce4c12dd70224fae02777d0ea60ab353be8ba8262314f73a2fc2dd9" exitCode=0 Nov 03 17:30:00.481532 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:00.481101 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brrzg" event={"ID":"190d67b2-f12d-45e3-8743-cd793696d19d","Type":"ContainerDied","Data":"4f9f48111ce4c12dd70224fae02777d0ea60ab353be8ba8262314f73a2fc2dd9"} Nov 03 17:30:00.483448 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:00.483419 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" event={"ID":"2caff5b7-abb0-4c7d-8e95-e830602cdbd6","Type":"ContainerStarted","Data":"8610a1ae5213e4381e0091328442a8da0a21bf0dfb0ac63101d5d768c5863b2c"} Nov 03 17:30:00.487659 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:00.487637 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ld2j9" Nov 03 17:30:00.545270 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:00.545226 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2md9c" podStartSLOduration=2.07225504 podStartE2EDuration="3.545208208s" totalImagesPullingTime="1.472953168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:00.544042626 +0000 UTC m=+32.381155450" watchObservedRunningTime="2026-11-03 17:30:00.545208208 +0000 UTC m=+32.382321033" Nov 03 17:30:01.489292 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:01.489252 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brrzg" event={"ID":"190d67b2-f12d-45e3-8743-cd793696d19d","Type":"ContainerStarted","Data":"bab688ffe8e2fcbadfb032ff1eadfa5b6ae39f1d853d2ab1a8573f3466da5dab"} Nov 03 17:30:01.489734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:01.489309 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brrzg" event={"ID":"190d67b2-f12d-45e3-8743-cd793696d19d","Type":"ContainerStarted","Data":"255313a8ca26a2425496e0d357241d82fe788804c5e128b9355c7679e8ad1190"} Nov 03 17:30:01.513850 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:01.513798 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brrzg" podStartSLOduration=2.513800236 podStartE2EDuration="4.513780012s" totalImagesPullingTime="1.925507645s" totalInitContainerRuntime="74.472131ms" isStatefulPod=true podCreationTimestamp="2026-11-03 17:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:01.511948392 +0000 UTC m=+33.349061216" watchObservedRunningTime="2026-11-03 17:30:01.513780012 +0000 UTC m=+33.350892863" Nov 03 17:30:02.329015 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.328978 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j"] Nov 03 17:30:02.346849 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.346818 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j"] Nov 03 17:30:02.347023 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.346944 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.356131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.356110 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b9tkb\"" Nov 03 17:30:02.356131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.356110 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 03 17:30:02.435161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.435128 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbcv\" (UniqueName: \"kubernetes.io/projected/d71b822c-57a9-43ed-8304-3353af079f61-kube-api-access-tnbcv\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.435370 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.435182 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d71b822c-57a9-43ed-8304-3353af079f61-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.536533 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.536499 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbcv\" (UniqueName: \"kubernetes.io/projected/d71b822c-57a9-43ed-8304-3353af079f61-kube-api-access-tnbcv\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.536928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.536549 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d71b822c-57a9-43ed-8304-3353af079f61-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.539172 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.539142 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d71b822c-57a9-43ed-8304-3353af079f61-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.548638 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.548616 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbcv\" (UniqueName: \"kubernetes.io/projected/d71b822c-57a9-43ed-8304-3353af079f61-kube-api-access-tnbcv\") pod \"monitoring-plugin-77f4f76594-p9w7j\" (UID: \"d71b822c-57a9-43ed-8304-3353af079f61\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.673847 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.673821 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:02.958361 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:02.958262 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j"] Nov 03 17:30:02.961125 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:30:02.961097 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71b822c_57a9_43ed_8304_3353af079f61.slice/crio-d486712df141ca279c0befdd7ea1a38eb0f712932c6386aa55b90177c90d754f WatchSource:0}: Error finding container d486712df141ca279c0befdd7ea1a38eb0f712932c6386aa55b90177c90d754f: Status 404 returned error can't find the container with id d486712df141ca279c0befdd7ea1a38eb0f712932c6386aa55b90177c90d754f Nov 03 17:30:03.496642 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.496605 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" event={"ID":"d71b822c-57a9-43ed-8304-3353af079f61","Type":"ContainerStarted","Data":"d486712df141ca279c0befdd7ea1a38eb0f712932c6386aa55b90177c90d754f"} Nov 03 17:30:03.854610 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.851604 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:03.875954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.875918 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.876142 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.875986 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:03.882808 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882775 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-365br55cfsn2b\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882840 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882883 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882897 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882946 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882959 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 03 17:30:03.882968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882884 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 03 17:30:03.883229 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.882992 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 03 17:30:03.883229 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.883046 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 03 17:30:03.883229 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.883162 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 03 17:30:03.883946 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.883916 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 03 17:30:03.884056 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.883972 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 03 17:30:03.884056 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.884044 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 03 17:30:03.884276 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.884120 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 03 17:30:03.884366 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.884337 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7zscc\"" Nov 03 17:30:03.886390 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.886368 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 03 17:30:03.889311 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.889293 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 03 17:30:03.947116 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947065 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947116 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947120 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947147 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947219 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947284 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947321 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947354 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947421 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947448 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947481 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947507 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947617 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947649 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947667 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947697 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947719 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947760 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7f6b\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947819 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.947914 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947851 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:03.948135 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:03.947929 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048344 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048307 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048344 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048343 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7f6b\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048366 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048382 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048404 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048608 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048654 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048689 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048716 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.048765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048746 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048774 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048823 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048848 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048872 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048904 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048928 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.048971 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.049016 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.049039 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.049071 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.049461 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.049765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.049719 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.051654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.051625 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.051890 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.051866 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.052027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.052004 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.052284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.052266 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.052367 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.052321 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.052521 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.052498 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.053347 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.052738 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.053347 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.053293 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.055698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.055670 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056070 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056048 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056153 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056109 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056240 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056223 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056266 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056272 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056283 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.056433 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.056416 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.057125 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.057101 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.061267 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.061245 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7f6b\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\") pod \"prometheus-k8s-0\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.204689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.204643 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:04.496753 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:04.496659 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:04.500342 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:30:04.500307 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9f9bd8_5269_49be_a29d_a4591672ebbf.slice/crio-a09f6c4918da25321823e733bf37167f31587f095c54418dceee5d5bb0fb3742 WatchSource:0}: Error finding container a09f6c4918da25321823e733bf37167f31587f095c54418dceee5d5bb0fb3742: Status 404 returned error can't find the container with id a09f6c4918da25321823e733bf37167f31587f095c54418dceee5d5bb0fb3742 Nov 03 17:30:05.509634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:05.509595 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"a09f6c4918da25321823e733bf37167f31587f095c54418dceee5d5bb0fb3742"} Nov 03 17:30:05.510998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:05.510977 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" event={"ID":"d71b822c-57a9-43ed-8304-3353af079f61","Type":"ContainerStarted","Data":"1eedba76abf53b0583b3aa88cff3fb648e6b93004b367f8ef63e70b2f1ea8af7"} Nov 03 17:30:05.511207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:05.511180 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:05.516119 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:05.516091 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" Nov 03 17:30:05.531917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:05.531869 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-p9w7j" podStartSLOduration=1.7923263249999999 podStartE2EDuration="3.53185796s" totalImagesPullingTime="1.739531635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:05.53124644 +0000 UTC m=+37.368359264" watchObservedRunningTime="2026-11-03 17:30:05.53185796 +0000 UTC m=+37.368970783" Nov 03 17:30:06.516187 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:06.516150 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" exitCode=0 Nov 03 17:30:06.516597 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:06.516242 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} Nov 03 17:30:10.533017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:10.532977 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} Nov 03 17:30:10.533385 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:10.533047 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} Nov 03 17:30:12.451833 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:12.451796 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-674c8fbb7b-52jb7" Nov 03 17:30:13.550977 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:13.550939 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} Nov 03 17:30:13.551351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:13.551046 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} Nov 03 17:30:13.551351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:13.551092 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} Nov 03 17:30:13.551351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:13.551129 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerStarted","Data":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} Nov 03 17:30:13.593546 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:13.593488 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.097442728 podStartE2EDuration="10.593473554s" totalImagesPullingTime="7.482232538s" totalInitContainerRuntime="13.798288ms" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:13.59282695 +0000 UTC m=+45.429939798" watchObservedRunningTime="2026-11-03 17:30:13.593473554 +0000 UTC m=+45.430586427" Nov 03 17:30:14.205451 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:14.205409 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:19.414217 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:19.414171 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:30:22.666354 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:22.666314 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:22.684266 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:22.684239 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:23.599206 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:23.599174 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:49.413838 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:49.413795 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:30:51.754840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.754799 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:51.755377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755326 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="prometheus" containerID="cri-o://5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" gracePeriod=600 Nov 03 17:30:51.755454 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755363 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="thanos-sidecar" containerID="cri-o://f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" gracePeriod=600 Nov 03 17:30:51.755454 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755365 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy" containerID="cri-o://c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" gracePeriod=600 Nov 03 17:30:51.755561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755439 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-web" containerID="cri-o://3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" gracePeriod=600 Nov 03 17:30:51.755561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755443 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" gracePeriod=600 Nov 03 17:30:51.755686 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.755443 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="config-reloader" containerID="cri-o://00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" gracePeriod=600 Nov 03 17:30:51.993030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:51.993000 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.022478 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022394 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022478 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022441 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022485 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022513 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022547 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022600 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022630 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022657 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022682 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.022721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022716 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022745 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022782 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022811 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022846 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022883 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022912 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022945 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.022988 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023036 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023064 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.023109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023096 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\") pod \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\" (UID: \"fe9f9bd8-5269-49be-a29d-a4591672ebbf\") " Nov 03 17:30:52.023686 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023155 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.023686 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023333 4557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.023686 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023354 4557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.023918 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.023850 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:30:52.024262 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.024231 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.025137 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.024990 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.025137 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025109 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.025320 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025293 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.025320 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025416 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.025990 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025692 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.025990 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025842 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.025990 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.025950 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:30:52.026279 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.026254 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:30:52.027101 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.027078 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.027291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.027263 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.027398 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.027373 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.027535 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.027513 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.027683 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.027656 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.028086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.028063 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "kube-api-access-f7f6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:30:52.028409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.028389 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:30:52.037132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.037105 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config" pod "fe9f9bd8-5269-49be-a29d-a4591672ebbf" (UID: "fe9f9bd8-5269-49be-a29d-a4591672ebbf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:30:52.123931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123897 4557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-db\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.123931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123929 4557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123942 4557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123952 4557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config-out\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123962 4557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123971 4557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-config\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123980 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7f6b\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-kube-api-access-f7f6b\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123988 4557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.123997 4557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124005 4557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124014 4557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-grpc-tls\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124022 4557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-web-config\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124030 4557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe9f9bd8-5269-49be-a29d-a4591672ebbf-tls-assets\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124038 4557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-kube-rbac-proxy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124046 4557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124055 4557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe9f9bd8-5269-49be-a29d-a4591672ebbf-configmap-metrics-client-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124063 4557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-metrics-client-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.124122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.124071 4557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe9f9bd8-5269-49be-a29d-a4591672ebbf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:30:52.685341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685311 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" exitCode=0 Nov 03 17:30:52.685341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685338 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" exitCode=0 Nov 03 17:30:52.685341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685346 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" exitCode=0 Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685355 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" exitCode=0 Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685363 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" exitCode=0 Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685370 4557 generic.go:356] "Generic (PLEG): container finished" podID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" exitCode=0 Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685373 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685390 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685456 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685487 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685517 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685539 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.685583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685556 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} Nov 03 17:30:52.685929 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685608 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} Nov 03 17:30:52.685929 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.685648 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe9f9bd8-5269-49be-a29d-a4591672ebbf","Type":"ContainerDied","Data":"a09f6c4918da25321823e733bf37167f31587f095c54418dceee5d5bb0fb3742"} Nov 03 17:30:52.693746 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.693727 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.700705 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.700683 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.707041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.707020 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.708880 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.708858 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:52.713785 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.713758 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:52.714339 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.714326 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.720790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.720773 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.727770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.727750 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.734343 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.734316 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.734637 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.734617 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.734721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.734651 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.734721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.734701 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.734978 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.734959 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.735024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.734988 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.735024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735004 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.735220 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.735203 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.735284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735228 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.735284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735247 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.735456 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.735441 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.735494 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735460 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.735494 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735473 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.735986 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.735968 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.736067 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.735998 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.736067 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736011 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.736234 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.736216 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.736287 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736239 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.736287 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736255 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.736605 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:30:52.736580 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.736674 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736612 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.736674 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736626 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.736837 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736817 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.736879 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.736838 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.737057 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737037 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.737132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737059 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.737330 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737313 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.737380 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737330 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.737543 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737528 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.737592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737544 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.737772 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737752 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.737810 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.737773 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.738019 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738002 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.738055 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738021 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.738231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738216 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.738276 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738230 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.738431 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738410 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.738431 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738428 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.738654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738637 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.738703 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738654 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.738894 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738875 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.738938 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.738895 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.739103 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739086 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.739148 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739104 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.739296 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739281 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.739331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739297 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.739479 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739461 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.739515 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739480 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.739678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739663 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.739726 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739679 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.739860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739843 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.739903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.739861 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.740046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740030 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.740091 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740046 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.740222 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740205 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.740266 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740222 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.740428 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740413 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.740471 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740427 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.740691 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740674 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.740739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740691 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.740877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740862 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.740877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.740876 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.741078 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741058 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.741127 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741079 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.741287 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741268 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.741333 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741288 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.741499 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741482 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.741541 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741499 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.741700 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741686 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.741744 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741700 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.741941 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741923 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.741985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.741941 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.742160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742139 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.742202 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742161 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.742365 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742345 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.742408 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742366 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.742549 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742533 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.742602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742549 4557 scope.go:122] "RemoveContainer" containerID="e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3" Nov 03 17:30:52.742777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742758 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3"} err="failed to get container status \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": rpc error: code = NotFound desc = could not find container \"e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3\": container with ID starting with e286a70c2f54e91d79292387d1c443e0a76df484a0c4f0dd7f4c658dee852cc3 not found: ID does not exist" Nov 03 17:30:52.742820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742778 4557 scope.go:122] "RemoveContainer" containerID="c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882" Nov 03 17:30:52.742974 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742955 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882"} err="failed to get container status \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": rpc error: code = NotFound desc = could not find container \"c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882\": container with ID starting with c6c1f2bab84c8c6a942e1cfee996b5a95467848d3791cd318c180e32b5763882 not found: ID does not exist" Nov 03 17:30:52.743016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.742975 4557 scope.go:122] "RemoveContainer" containerID="3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea" Nov 03 17:30:52.743154 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743139 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea"} err="failed to get container status \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": rpc error: code = NotFound desc = could not find container \"3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea\": container with ID starting with 3fcff8d112c0c3dbf80640f2949348bb8b7efc01b4339ec41eada581c4a9deea not found: ID does not exist" Nov 03 17:30:52.743189 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743153 4557 scope.go:122] "RemoveContainer" containerID="f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1" Nov 03 17:30:52.743352 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743336 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1"} err="failed to get container status \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": rpc error: code = NotFound desc = could not find container \"f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1\": container with ID starting with f04fc6131b896e421e5044f220b9d06872dc9401a92ea332ddbfdbef660cbbe1 not found: ID does not exist" Nov 03 17:30:52.743394 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743353 4557 scope.go:122] "RemoveContainer" containerID="00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1" Nov 03 17:30:52.743545 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743527 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1"} err="failed to get container status \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": rpc error: code = NotFound desc = could not find container \"00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1\": container with ID starting with 00d5fe67ff590f71be5d907dcfcc94f43f53cc6546f5a5b8067bc24242d682c1 not found: ID does not exist" Nov 03 17:30:52.743605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743546 4557 scope.go:122] "RemoveContainer" containerID="5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64" Nov 03 17:30:52.743782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743762 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64"} err="failed to get container status \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": rpc error: code = NotFound desc = could not find container \"5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64\": container with ID starting with 5ef9538a9fce7a7fddb28237fe1d784c63152f1a2bee7575c896758d2c3c8e64 not found: ID does not exist" Nov 03 17:30:52.743826 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743783 4557 scope.go:122] "RemoveContainer" containerID="56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3" Nov 03 17:30:52.743984 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.743965 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3"} err="failed to get container status \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": rpc error: code = NotFound desc = could not find container \"56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3\": container with ID starting with 56b8a7b945ccdfaf993da647d26dead660a7c972d4ca1964ae3642df5f2108d3 not found: ID does not exist" Nov 03 17:30:52.747766 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.747746 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:52.747993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.747976 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy" Nov 03 17:30:52.747993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.747989 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748001 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="thanos-sidecar" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748006 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="thanos-sidecar" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748019 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="config-reloader" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748025 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="config-reloader" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748033 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="init-config-reloader" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748037 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="init-config-reloader" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748044 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="prometheus" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748048 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="prometheus" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748056 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-web" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748060 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-web" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748067 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-thanos" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748071 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-thanos" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748105 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="prometheus" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748113 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-web" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748119 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy-thanos" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748125 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="kube-rbac-proxy" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748130 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="thanos-sidecar" Nov 03 17:30:52.748131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.748136 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" containerName="config-reloader" Nov 03 17:30:52.751225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.751210 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.758420 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758395 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758438 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758438 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758476 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7zscc\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758487 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758520 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758531 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758561 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758668 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758678 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-365br55cfsn2b\"" Nov 03 17:30:52.758793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.758716 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 03 17:30:52.759123 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.759083 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 03 17:30:52.759123 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.759102 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 03 17:30:52.759257 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.759245 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 03 17:30:52.759835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.759822 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 17:30:52.765730 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.765712 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 03 17:30:52.765843 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.765828 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 03 17:30:52.771862 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.771842 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:52.828656 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828623 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828656 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828659 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828678 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828763 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828813 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828839 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.828871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828858 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828883 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828899 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828926 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828972 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.828997 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829043 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829059 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829116 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829132 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829149 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829168 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtp7\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-kube-api-access-tbtp7\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829204 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.829345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.829264 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930617 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930557 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930617 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930622 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930647 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930672 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930696 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930727 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930747 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930777 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.930817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930793 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930821 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930855 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtp7\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-kube-api-access-tbtp7\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930879 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930916 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.930999 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931028 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931059 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931089 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931120 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931151 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931182 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931279 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.931770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.931400 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.932781 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.932435 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.932781 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.932433 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.933144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.933114 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.933903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.933751 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.933903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.933766 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.934086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.933953 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.934086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.934042 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.934288 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.934266 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.934737 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.934713 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.934836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.934749 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.935075 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.935052 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2df7c16-3d36-4e66-8d31-45433561fb42-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.935469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.935427 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.936157 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.936136 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2df7c16-3d36-4e66-8d31-45433561fb42-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.936611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.936591 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.936707 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.936587 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.937174 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.937149 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.937400 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.937384 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2df7c16-3d36-4e66-8d31-45433561fb42-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:52.946497 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:52.946475 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtp7\" (UniqueName: \"kubernetes.io/projected/a2df7c16-3d36-4e66-8d31-45433561fb42-kube-api-access-tbtp7\") pod \"prometheus-k8s-0\" (UID: \"a2df7c16-3d36-4e66-8d31-45433561fb42\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:53.086907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:53.086852 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:30:53.378804 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:53.378781 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 03 17:30:53.380581 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:30:53.380544 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2df7c16_3d36_4e66_8d31_45433561fb42.slice/crio-df11a04e449afbd5612c3b68540a229113c74b2e13aa07c6687aa4e36ccfe908 WatchSource:0}: Error finding container df11a04e449afbd5612c3b68540a229113c74b2e13aa07c6687aa4e36ccfe908: Status 404 returned error can't find the container with id df11a04e449afbd5612c3b68540a229113c74b2e13aa07c6687aa4e36ccfe908 Nov 03 17:30:53.691040 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:53.691005 4557 generic.go:356] "Generic (PLEG): container finished" podID="a2df7c16-3d36-4e66-8d31-45433561fb42" containerID="5a0275d57aee60e282c9e5524b4ca9ebeae8119ea576f5c624736d0d30301f4f" exitCode=0 Nov 03 17:30:53.691237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:53.691051 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerDied","Data":"5a0275d57aee60e282c9e5524b4ca9ebeae8119ea576f5c624736d0d30301f4f"} Nov 03 17:30:53.691237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:53.691098 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"df11a04e449afbd5612c3b68540a229113c74b2e13aa07c6687aa4e36ccfe908"} Nov 03 17:30:54.325227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.325148 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe9f9bd8-5269-49be-a29d-a4591672ebbf" path="/var/lib/kubelet/pods/fe9f9bd8-5269-49be-a29d-a4591672ebbf/volumes" Nov 03 17:30:54.697933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.697901 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"a7881147f5a525ded3bee8a6428fd9c6daf7d16dc76dfc8bdf412dfeeba12ef4"} Nov 03 17:30:54.698080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.697964 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"c094b3727ed26ad3968e994ca73ea82bdda59becc51109cfc0b223dd646af82f"} Nov 03 17:30:54.698080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.697990 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"d1c6a4205eb856f6975b3aac30adc884040a63b134ce3b45ea7a328eedcf78f6"} Nov 03 17:30:54.698080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.698013 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"92616fff4f793dc3ed954fb1a202da208eb6292408b0435597c9216d24fe0460"} Nov 03 17:30:54.698080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.698039 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"71bdf8edb9b7bb5ab177e3f43498b227152a8cab20d8a5eca1d09a2509b23c0b"} Nov 03 17:30:54.698080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.698061 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2df7c16-3d36-4e66-8d31-45433561fb42","Type":"ContainerStarted","Data":"2c418330fcce22a38652a14f3a196325a04ff980bac6968f2d1b7108c81dd85e"} Nov 03 17:30:54.748783 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:54.748721 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.731381995 podStartE2EDuration="2.748703808s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.321813ms" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:54.746914199 +0000 UTC m=+86.584027023" watchObservedRunningTime="2026-11-03 17:30:54.748703808 +0000 UTC m=+86.585816633" Nov 03 17:30:58.087372 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:30:58.087330 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:31:03.769797 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:03.769761 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:31:03.770207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:03.769955 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" podUID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" containerName="insights-gathering" containerID="cri-o://61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393" gracePeriod=30 Nov 03 17:31:04.006522 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.006497 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:31:04.119684 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.119587 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") pod \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " Nov 03 17:31:04.119684 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.119663 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") pod \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " Nov 03 17:31:04.119913 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.119724 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") pod \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " Nov 03 17:31:04.119913 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.119794 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") pod \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\" (UID: \"83ad57d5-5fb7-4db3-ac50-d011675b0ca4\") " Nov 03 17:31:04.120013 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.119988 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path" pod "83ad57d5-5fb7-4db3-ac50-d011675b0ca4" (UID: "83ad57d5-5fb7-4db3-ac50-d011675b0ca4"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:31:04.120054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.120019 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle" pod "83ad57d5-5fb7-4db3-ac50-d011675b0ca4" (UID: "83ad57d5-5fb7-4db3-ac50-d011675b0ca4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:31:04.120133 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.120110 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle" pod "83ad57d5-5fb7-4db3-ac50-d011675b0ca4" (UID: "83ad57d5-5fb7-4db3-ac50-d011675b0ca4"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:31:04.121998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.121979 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b" pod "83ad57d5-5fb7-4db3-ac50-d011675b0ca4" (UID: "83ad57d5-5fb7-4db3-ac50-d011675b0ca4"). InnerVolumeSpecName "kube-api-access-kbj2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:31:04.221062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.221024 4557 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-archives-path\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:31:04.221062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.221057 4557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-trusted-ca-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:31:04.221062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.221067 4557 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-service-ca-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:31:04.221287 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.221077 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbj2b\" (UniqueName: \"kubernetes.io/projected/83ad57d5-5fb7-4db3-ac50-d011675b0ca4-kube-api-access-kbj2b\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:31:04.732010 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.731965 4557 generic.go:356] "Generic (PLEG): container finished" podID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" containerID="61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393" exitCode=2 Nov 03 17:31:04.732178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.732029 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" Nov 03 17:31:04.732178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.732052 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" event={"ID":"83ad57d5-5fb7-4db3-ac50-d011675b0ca4","Type":"ContainerDied","Data":"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393"} Nov 03 17:31:04.732178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.732109 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vtgkc-jzwjk" event={"ID":"83ad57d5-5fb7-4db3-ac50-d011675b0ca4","Type":"ContainerDied","Data":"4408d75c337588647ce6f8444bb89b10391fb1755188c1030dff5fa7d73ede58"} Nov 03 17:31:04.732178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.732136 4557 scope.go:122] "RemoveContainer" containerID="61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393" Nov 03 17:31:04.739756 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.739735 4557 scope.go:122] "RemoveContainer" containerID="61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393" Nov 03 17:31:04.740008 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:31:04.739987 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393\": container with ID starting with 61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393 not found: ID does not exist" containerID="61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393" Nov 03 17:31:04.740080 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.740021 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393"} err="failed to get container status \"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393\": rpc error: code = NotFound desc = could not find container \"61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393\": container with ID starting with 61e5284c182f9ca1a1f1973c7d35c0596ad0cbaff315d4ae573f98e431c4d393 not found: ID does not exist" Nov 03 17:31:04.750027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.750000 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:31:04.756129 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:04.756104 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-vtgkc-jzwjk"] Nov 03 17:31:06.321098 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:06.321069 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" path="/var/lib/kubelet/pods/83ad57d5-5fb7-4db3-ac50-d011675b0ca4/volumes" Nov 03 17:31:19.413927 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:31:19.413881 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:31:49.414017 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:31:49.413974 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:31:53.087490 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:53.087454 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:31:53.102827 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:53.102796 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:31:53.925827 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:31:53.925801 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 03 17:32:19.414192 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:32:19.414157 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:32:49.414332 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:32:49.414293 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:33:19.414798 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:33:19.414716 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:33:49.415014 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:33:49.414973 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:34:19.414025 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:34:19.413987 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:34:25.035988 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.035957 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw"] Nov 03 17:34:25.036363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.036213 4557 cpu_manager.go:414] "containerMap: removing container" podUID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" containerName="insights-gathering" Nov 03 17:34:25.036363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.036224 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" containerName="insights-gathering" Nov 03 17:34:25.036363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.036282 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="83ad57d5-5fb7-4db3-ac50-d011675b0ca4" containerName="insights-gathering" Nov 03 17:34:25.039239 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.039220 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.045762 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.045739 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-mnvrr\"" Nov 03 17:34:25.065158 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.065127 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 17:34:25.065411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.065394 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 17:34:25.077601 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.077558 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw"] Nov 03 17:34:25.127132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.127041 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qs2\" (UniqueName: \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.127132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.127090 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.127368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.127211 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.174742 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.174708 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9"] Nov 03 17:34:25.178924 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.178907 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.183725 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.183706 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-nlgfx\"" Nov 03 17:34:25.193659 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.193629 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9"] Nov 03 17:34:25.228250 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228213 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.228429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228262 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.228476 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228428 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.228528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228486 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qs2\" (UniqueName: \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.228528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228512 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dj6v\" (UniqueName: \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.228665 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228540 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.228725 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228685 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.228835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.228815 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.243017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.242989 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qs2\" (UniqueName: \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.262742 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.262710 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb"] Nov 03 17:34:25.266093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.266076 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.278802 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.278779 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb"] Nov 03 17:34:25.284140 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.284119 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-6c459\"" Nov 03 17:34:25.309323 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.309293 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9"] Nov 03 17:34:25.312690 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.312674 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.323088 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.323065 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9"] Nov 03 17:34:25.329185 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329160 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.329300 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329192 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.329300 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329222 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dj6v\" (UniqueName: \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.329406 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329348 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47hd\" (UniqueName: \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.329460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329406 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.329460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329428 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.329772 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329744 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.329834 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.329768 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.342207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.342179 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dj6v\" (UniqueName: \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.354857 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.354831 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:25.384294 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.384234 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-mbxcq\"" Nov 03 17:34:25.430188 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430154 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.430329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430200 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k272b\" (UniqueName: \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.430329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430222 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.430329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430238 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.430329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430264 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47hd\" (UniqueName: \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.430329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430301 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.430978 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.430955 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.431120 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.431102 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.443835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.443802 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47hd\" (UniqueName: \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.494318 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.494282 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:25.531732 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.531683 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.531928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.531762 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k272b\" (UniqueName: \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.531928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.531791 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.532294 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.532267 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.532347 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.532279 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.545374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.545324 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k272b\" (UniqueName: \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.585642 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.585612 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:25.644836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.644739 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:25.650859 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.650748 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw"] Nov 03 17:34:25.767461 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.767427 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9"] Nov 03 17:34:25.770612 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:34:25.770585 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad30c1e_6470_4215_ae92_9e33324820ae.slice/crio-e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6 WatchSource:0}: Error finding container e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6: Status 404 returned error can't find the container with id e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6 Nov 03 17:34:25.894142 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.894117 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb"] Nov 03 17:34:25.896509 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:34:25.896455 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc497a771_1ef0_424a_8f51_42071978ba01.slice/crio-0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463 WatchSource:0}: Error finding container 0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463: Status 404 returned error can't find the container with id 0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463 Nov 03 17:34:25.926826 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:25.926797 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9"] Nov 03 17:34:25.929550 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:34:25.929526 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1efc87d_0fd3_43ec_897a_91e2171d1fc0.slice/crio-ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450 WatchSource:0}: Error finding container ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450: Status 404 returned error can't find the container with id ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450 Nov 03 17:34:26.408303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:26.408261 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" event={"ID":"a1efc87d-0fd3-43ec-897a-91e2171d1fc0","Type":"ContainerStarted","Data":"ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450"} Nov 03 17:34:26.409693 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:26.409664 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" event={"ID":"3ad30c1e-6470-4215-ae92-9e33324820ae","Type":"ContainerStarted","Data":"e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6"} Nov 03 17:34:26.411202 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:26.411175 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerStarted","Data":"6bd7a50027f3e31b883a93314501bd9b343570b638fae732866b549aa2c05df5"} Nov 03 17:34:26.413845 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:26.413819 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" event={"ID":"c497a771-1ef0-424a-8f51-42071978ba01","Type":"ContainerStarted","Data":"0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463"} Nov 03 17:34:28.367119 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:28.367085 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:34:28.367803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:28.367782 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:34:34.458404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:34.457813 4557 generic.go:356] "Generic (PLEG): container finished" podID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerID="3b22be81a4e39d8b6b6898d4c5abb47bc8f2395da0ae303fea64c0ccef2f269f" exitCode=0 Nov 03 17:34:34.458404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:34.457881 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" event={"ID":"3ad30c1e-6470-4215-ae92-9e33324820ae","Type":"ContainerDied","Data":"3b22be81a4e39d8b6b6898d4c5abb47bc8f2395da0ae303fea64c0ccef2f269f"} Nov 03 17:34:34.459277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:34.459252 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:34:35.463159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.463126 4557 generic.go:356] "Generic (PLEG): container finished" podID="c497a771-1ef0-424a-8f51-42071978ba01" containerID="4ee39cbee23fec7d94c20d2f57bdd70daed3592448b5d500f293510dae75db0b" exitCode=0 Nov 03 17:34:35.463613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.463211 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" event={"ID":"c497a771-1ef0-424a-8f51-42071978ba01","Type":"ContainerDied","Data":"4ee39cbee23fec7d94c20d2f57bdd70daed3592448b5d500f293510dae75db0b"} Nov 03 17:34:35.464823 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.464793 4557 generic.go:356] "Generic (PLEG): container finished" podID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerID="b10a7a72fec7d5de1f59d2f5a1e022258ea5971926f88c2d3d198f90527d8dea" exitCode=0 Nov 03 17:34:35.464950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.464825 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" event={"ID":"a1efc87d-0fd3-43ec-897a-91e2171d1fc0","Type":"ContainerDied","Data":"b10a7a72fec7d5de1f59d2f5a1e022258ea5971926f88c2d3d198f90527d8dea"} Nov 03 17:34:35.466900 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.466792 4557 generic.go:356] "Generic (PLEG): container finished" podID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerID="8a8ab7f2fbf7c11ef1efc26247d0a707df78c4d1a1c4988aca6cff66e61b8338" exitCode=0 Nov 03 17:34:35.466900 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:35.466820 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerDied","Data":"8a8ab7f2fbf7c11ef1efc26247d0a707df78c4d1a1c4988aca6cff66e61b8338"} Nov 03 17:34:36.471701 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.471670 4557 generic.go:356] "Generic (PLEG): container finished" podID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerID="176521ee4bd4273b0600a494ea10c9170b62db2a215ed2751b267de8fb8f1589" exitCode=0 Nov 03 17:34:36.472163 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.471716 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" event={"ID":"a1efc87d-0fd3-43ec-897a-91e2171d1fc0","Type":"ContainerDied","Data":"176521ee4bd4273b0600a494ea10c9170b62db2a215ed2751b267de8fb8f1589"} Nov 03 17:34:36.473651 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.473536 4557 generic.go:356] "Generic (PLEG): container finished" podID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerID="591c876c0b2e07d25c5fb1f58cf4a8cec3540caaadcc109a06328871f88f70e3" exitCode=0 Nov 03 17:34:36.473651 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.473595 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" event={"ID":"3ad30c1e-6470-4215-ae92-9e33324820ae","Type":"ContainerDied","Data":"591c876c0b2e07d25c5fb1f58cf4a8cec3540caaadcc109a06328871f88f70e3"} Nov 03 17:34:36.475493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.475464 4557 generic.go:356] "Generic (PLEG): container finished" podID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerID="2877fe5da7498fca178038101c5ab07e816f1d833114eab87411975287a2daaf" exitCode=0 Nov 03 17:34:36.475629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.475548 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerDied","Data":"2877fe5da7498fca178038101c5ab07e816f1d833114eab87411975287a2daaf"} Nov 03 17:34:36.477603 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.477581 4557 generic.go:356] "Generic (PLEG): container finished" podID="c497a771-1ef0-424a-8f51-42071978ba01" containerID="3c6fd9829c20a6a99176ffe5178266e7b65608bf2f6c634dd7f05641986fa737" exitCode=0 Nov 03 17:34:36.477683 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:36.477602 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" event={"ID":"c497a771-1ef0-424a-8f51-42071978ba01","Type":"ContainerDied","Data":"3c6fd9829c20a6a99176ffe5178266e7b65608bf2f6c634dd7f05641986fa737"} Nov 03 17:34:45.525112 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:45.525067 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerStarted","Data":"81f690906986b8d85a10326e57224bc521a60f8cf39f7a01d59bb0d323140956"} Nov 03 17:34:45.550229 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:45.550178 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" podStartSLOduration=2.033480105 podStartE2EDuration="20.550160504s" totalImagesPullingTime="18.516680399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:34:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:34:45.548789592 +0000 UTC m=+317.385902417" watchObservedRunningTime="2026-11-03 17:34:45.550160504 +0000 UTC m=+317.387273329" Nov 03 17:34:46.531803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.531764 4557 generic.go:356] "Generic (PLEG): container finished" podID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerID="6f9e74ea8983d770c320f64259ef48735e70449d0b326fdb17b31ce6cdc17635" exitCode=0 Nov 03 17:34:46.532270 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.531847 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" event={"ID":"a1efc87d-0fd3-43ec-897a-91e2171d1fc0","Type":"ContainerDied","Data":"6f9e74ea8983d770c320f64259ef48735e70449d0b326fdb17b31ce6cdc17635"} Nov 03 17:34:46.534461 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.534436 4557 generic.go:356] "Generic (PLEG): container finished" podID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerID="05c9843db6cb79e2043781ae9c7c84f0a723b4957a2b7c387a687e7aef978a56" exitCode=0 Nov 03 17:34:46.534608 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.534525 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" event={"ID":"3ad30c1e-6470-4215-ae92-9e33324820ae","Type":"ContainerDied","Data":"05c9843db6cb79e2043781ae9c7c84f0a723b4957a2b7c387a687e7aef978a56"} Nov 03 17:34:46.536870 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.536844 4557 generic.go:356] "Generic (PLEG): container finished" podID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerID="81f690906986b8d85a10326e57224bc521a60f8cf39f7a01d59bb0d323140956" exitCode=0 Nov 03 17:34:46.536969 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:46.536867 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerDied","Data":"81f690906986b8d85a10326e57224bc521a60f8cf39f7a01d59bb0d323140956"} Nov 03 17:34:47.543017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.542920 4557 generic.go:356] "Generic (PLEG): container finished" podID="c497a771-1ef0-424a-8f51-42071978ba01" containerID="d04a375103ba677bc0189c9e5c944dc58ef50eb65dcb742614f3c8e31b69f3e6" exitCode=0 Nov 03 17:34:47.543017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.542996 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" event={"ID":"c497a771-1ef0-424a-8f51-42071978ba01","Type":"ContainerDied","Data":"d04a375103ba677bc0189c9e5c944dc58ef50eb65dcb742614f3c8e31b69f3e6"} Nov 03 17:34:47.690888 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.690860 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:47.693739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.693712 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:47.716722 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.716697 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:47.852555 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852466 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\" (UniqueName: \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\") pod \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " Nov 03 17:34:47.852555 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852512 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\" (UniqueName: \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\") pod \"3ad30c1e-6470-4215-ae92-9e33324820ae\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " Nov 03 17:34:47.852555 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852541 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\") pod \"3ad30c1e-6470-4215-ae92-9e33324820ae\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852562 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\") pod \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852626 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\" (UniqueName: \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\") pod \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852650 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\") pod \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852676 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\") pod \"3ad30c1e-6470-4215-ae92-9e33324820ae\" (UID: \"3ad30c1e-6470-4215-ae92-9e33324820ae\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852695 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\") pod \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\" (UID: \"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf\") " Nov 03 17:34:47.852866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.852719 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\") pod \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\" (UID: \"a1efc87d-0fd3-43ec-897a-91e2171d1fc0\") " Nov 03 17:34:47.853907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.853548 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle" pod "3ad30c1e-6470-4215-ae92-9e33324820ae" (UID: "3ad30c1e-6470-4215-ae92-9e33324820ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.853907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.853724 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle" pod "a1efc87d-0fd3-43ec-897a-91e2171d1fc0" (UID: "a1efc87d-0fd3-43ec-897a-91e2171d1fc0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.853907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.853849 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle" pod "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" (UID: "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.855253 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.855228 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b" pod "a1efc87d-0fd3-43ec-897a-91e2171d1fc0" (UID: "a1efc87d-0fd3-43ec-897a-91e2171d1fc0"). InnerVolumeSpecName "kube-api-access-k272b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:34:47.855444 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.855417 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v" pod "3ad30c1e-6470-4215-ae92-9e33324820ae" (UID: "3ad30c1e-6470-4215-ae92-9e33324820ae"). InnerVolumeSpecName "kube-api-access-5dj6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:34:47.855512 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.855442 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2" pod "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" (UID: "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf"). InnerVolumeSpecName "kube-api-access-q2qs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:34:47.859060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.859042 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util" pod "3ad30c1e-6470-4215-ae92-9e33324820ae" (UID: "3ad30c1e-6470-4215-ae92-9e33324820ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.859393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.859361 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util" pod "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" (UID: "53c64c55-2c36-42d6-bfa5-0a19ea0a6caf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.861119 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.861095 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util" pod "a1efc87d-0fd3-43ec-897a-91e2171d1fc0" (UID: "a1efc87d-0fd3-43ec-897a-91e2171d1fc0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:47.953631 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953589 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k272b\" (UniqueName: \"kubernetes.io/projected/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-kube-api-access-k272b\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953631 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953624 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dj6v\" (UniqueName: \"kubernetes.io/projected/3ad30c1e-6470-4215-ae92-9e33324820ae-kube-api-access-5dj6v\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953631 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953638 4557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-util\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953651 4557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953663 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2qs2\" (UniqueName: \"kubernetes.io/projected/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-kube-api-access-q2qs2\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953678 4557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953689 4557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad30c1e-6470-4215-ae92-9e33324820ae-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953699 4557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53c64c55-2c36-42d6-bfa5-0a19ea0a6caf-util\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:47.953877 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:47.953709 4557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1efc87d-0fd3-43ec-897a-91e2171d1fc0-util\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:48.548948 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.548919 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" Nov 03 17:34:48.549404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.548915 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amcfs9" event={"ID":"a1efc87d-0fd3-43ec-897a-91e2171d1fc0","Type":"ContainerDied","Data":"ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450"} Nov 03 17:34:48.549404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.549043 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec07fff93a3b4f5e0e2c5edd117569048f4de01f47bc6194d54e78fd114ce450" Nov 03 17:34:48.551216 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.551195 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" Nov 03 17:34:48.551334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.551191 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7kfl9" event={"ID":"3ad30c1e-6470-4215-ae92-9e33324820ae","Type":"ContainerDied","Data":"e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6"} Nov 03 17:34:48.551334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.551316 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e39e2b9314ecc1f76d59f67584a2b79d15335fafe8f5a4882697bbbdaf0b58e6" Nov 03 17:34:48.553115 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.553096 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" Nov 03 17:34:48.553312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.553123 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xw2zw" event={"ID":"53c64c55-2c36-42d6-bfa5-0a19ea0a6caf","Type":"ContainerDied","Data":"6bd7a50027f3e31b883a93314501bd9b343570b638fae732866b549aa2c05df5"} Nov 03 17:34:48.553429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.553336 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bd7a50027f3e31b883a93314501bd9b343570b638fae732866b549aa2c05df5" Nov 03 17:34:48.668046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.668020 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:48.758369 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.758341 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\") pod \"c497a771-1ef0-424a-8f51-42071978ba01\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " Nov 03 17:34:48.758540 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.758435 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\") pod \"c497a771-1ef0-424a-8f51-42071978ba01\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " Nov 03 17:34:48.758540 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.758487 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\" (UniqueName: \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\") pod \"c497a771-1ef0-424a-8f51-42071978ba01\" (UID: \"c497a771-1ef0-424a-8f51-42071978ba01\") " Nov 03 17:34:48.758931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.758906 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle" pod "c497a771-1ef0-424a-8f51-42071978ba01" (UID: "c497a771-1ef0-424a-8f51-42071978ba01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:48.760409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.760379 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd" pod "c497a771-1ef0-424a-8f51-42071978ba01" (UID: "c497a771-1ef0-424a-8f51-42071978ba01"). InnerVolumeSpecName "kube-api-access-j47hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:34:48.763733 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.763702 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util" pod "c497a771-1ef0-424a-8f51-42071978ba01" (UID: "c497a771-1ef0-424a-8f51-42071978ba01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:34:48.859459 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.859380 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j47hd\" (UniqueName: \"kubernetes.io/projected/c497a771-1ef0-424a-8f51-42071978ba01-kube-api-access-j47hd\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:48.859459 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.859409 4557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-util\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:48.859459 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:48.859418 4557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c497a771-1ef0-424a-8f51-42071978ba01-bundle\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:34:49.414095 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:34:49.414052 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:34:49.558636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:49.558589 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" event={"ID":"c497a771-1ef0-424a-8f51-42071978ba01","Type":"ContainerDied","Data":"0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463"} Nov 03 17:34:49.558636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:49.558620 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7pc5bb" Nov 03 17:34:49.559083 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:34:49.558650 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c9ffe27de21a456333694156c10e5adc3fee1c6e43302467bbeb18fcaadc463" Nov 03 17:35:03.250489 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250453 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv"] Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250770 4557 cpu_manager.go:414] "containerMap: removing container" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250785 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250800 4557 cpu_manager.go:414] "containerMap: removing container" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250805 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250813 4557 cpu_manager.go:414] "containerMap: removing container" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250818 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250825 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250831 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250843 4557 cpu_manager.go:414] "containerMap: removing container" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250848 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250857 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250863 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250872 4557 cpu_manager.go:414] "containerMap: removing container" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250877 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250884 4557 cpu_manager.go:414] "containerMap: removing container" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250888 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250895 4557 cpu_manager.go:414] "containerMap: removing container" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250900 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="util" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250909 4557 cpu_manager.go:414] "containerMap: removing container" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250913 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="pull" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250919 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250923 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250932 4557 cpu_manager.go:414] "containerMap: removing container" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250937 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250983 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1efc87d-0fd3-43ec-897a-91e2171d1fc0" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250993 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ad30c1e-6470-4215-ae92-9e33324820ae" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.250999 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="53c64c55-2c36-42d6-bfa5-0a19ea0a6caf" containerName="extract" Nov 03 17:35:03.251134 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.251006 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="c497a771-1ef0-424a-8f51-42071978ba01" containerName="extract" Nov 03 17:35:03.254066 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.254045 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269385 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269347 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269406 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269481 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4r6\" (UniqueName: \"kubernetes.io/projected/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-kube-api-access-hh4r6\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269517 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-tmp\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269554 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.269698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.269610 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-manifests\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.308524 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.308477 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 03 17:35:03.308962 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.308939 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 03 17:35:03.309092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.308950 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 03 17:35:03.309092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.308976 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 03 17:35:03.309092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.309057 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wkmj8\"" Nov 03 17:35:03.309092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.309082 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 03 17:35:03.321231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.321194 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv"] Nov 03 17:35:03.370225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370180 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4r6\" (UniqueName: \"kubernetes.io/projected/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-kube-api-access-hh4r6\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370227 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-tmp\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370251 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370269 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-manifests\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370289 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370306 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.370813 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.370783 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-manifests\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.372548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.372522 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-tmp\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.372793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.372774 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.372959 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.372938 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.373025 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.372938 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.396741 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.396706 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4r6\" (UniqueName: \"kubernetes.io/projected/bba908a5-4ba6-40e8-bf5d-d735c8b8eace-kube-api-access-hh4r6\") pod \"opendatahub-operator-controller-manager-6f494f769f-hxpbv\" (UID: \"bba908a5-4ba6-40e8-bf5d-d735c8b8eace\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.571625 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.571502 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:03.877013 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:03.876987 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv"] Nov 03 17:35:03.878761 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:03.878735 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba908a5_4ba6_40e8_bf5d_d735c8b8eace.slice/crio-ca3351fa793b9b8a923cf588efcb29cf694c901bf35eaf5fd71bd539b2ea76ec WatchSource:0}: Error finding container ca3351fa793b9b8a923cf588efcb29cf694c901bf35eaf5fd71bd539b2ea76ec: Status 404 returned error can't find the container with id ca3351fa793b9b8a923cf588efcb29cf694c901bf35eaf5fd71bd539b2ea76ec Nov 03 17:35:04.612477 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:04.612444 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" event={"ID":"bba908a5-4ba6-40e8-bf5d-d735c8b8eace","Type":"ContainerStarted","Data":"ca3351fa793b9b8a923cf588efcb29cf694c901bf35eaf5fd71bd539b2ea76ec"} Nov 03 17:35:07.628093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:07.628060 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" event={"ID":"bba908a5-4ba6-40e8-bf5d-d735c8b8eace","Type":"ContainerStarted","Data":"006d4960eeef01fa9191aa8fb0a17752bcde7eae152f807ef93c65b145d131b0"} Nov 03 17:35:08.234757 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.234667 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb"] Nov 03 17:35:08.237915 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.237890 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.244625 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.244599 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 03 17:35:08.244625 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.244600 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 03 17:35:08.244777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.244623 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 03 17:35:08.244777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.244686 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 03 17:35:08.244777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.244687 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5wr2m\"" Nov 03 17:35:08.249744 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.249723 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb"] Nov 03 17:35:08.303445 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.303407 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befb32e-0a5e-4bca-835c-934649c9b9fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.303445 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.303448 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4befb32e-0a5e-4bca-835c-934649c9b9fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.303840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.303472 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg792\" (UniqueName: \"kubernetes.io/projected/4befb32e-0a5e-4bca-835c-934649c9b9fb-kube-api-access-bg792\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.404921 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.404888 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befb32e-0a5e-4bca-835c-934649c9b9fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.405118 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.404937 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4befb32e-0a5e-4bca-835c-934649c9b9fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.405118 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.404975 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg792\" (UniqueName: \"kubernetes.io/projected/4befb32e-0a5e-4bca-835c-934649c9b9fb-kube-api-access-bg792\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.405697 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.405678 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4befb32e-0a5e-4bca-835c-934649c9b9fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.407253 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.407222 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befb32e-0a5e-4bca-835c-934649c9b9fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.429919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.429889 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg792\" (UniqueName: \"kubernetes.io/projected/4befb32e-0a5e-4bca-835c-934649c9b9fb-kube-api-access-bg792\") pod \"kuadrant-console-plugin-66c4fb575d-hf6pb\" (UID: \"4befb32e-0a5e-4bca-835c-934649c9b9fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.561664 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.561562 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" Nov 03 17:35:08.636091 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.636059 4557 generic.go:356] "Generic (PLEG): container finished" podID="bba908a5-4ba6-40e8-bf5d-d735c8b8eace" containerID="006d4960eeef01fa9191aa8fb0a17752bcde7eae152f807ef93c65b145d131b0" exitCode=0 Nov 03 17:35:08.636433 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.636154 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" event={"ID":"bba908a5-4ba6-40e8-bf5d-d735c8b8eace","Type":"ContainerDied","Data":"006d4960eeef01fa9191aa8fb0a17752bcde7eae152f807ef93c65b145d131b0"} Nov 03 17:35:08.845496 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:08.845418 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb"] Nov 03 17:35:08.848022 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:08.847984 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4befb32e_0a5e_4bca_835c_934649c9b9fb.slice/crio-9de94b23bcf1929230ee0a4fd8ee80f40d147cfff296371b38f439232e7135d4 WatchSource:0}: Error finding container 9de94b23bcf1929230ee0a4fd8ee80f40d147cfff296371b38f439232e7135d4: Status 404 returned error can't find the container with id 9de94b23bcf1929230ee0a4fd8ee80f40d147cfff296371b38f439232e7135d4 Nov 03 17:35:09.642466 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:09.642434 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" event={"ID":"4befb32e-0a5e-4bca-835c-934649c9b9fb","Type":"ContainerStarted","Data":"9de94b23bcf1929230ee0a4fd8ee80f40d147cfff296371b38f439232e7135d4"} Nov 03 17:35:09.644275 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:09.644246 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" event={"ID":"bba908a5-4ba6-40e8-bf5d-d735c8b8eace","Type":"ContainerStarted","Data":"da762196b1fe354fa1988a3555329db4bf1a52cc5d7cfc7ee20fd3958537af56"} Nov 03 17:35:09.644401 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:09.644390 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:09.695867 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:09.695808 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" podStartSLOduration=2.309818729 podStartE2EDuration="6.695792711s" totalImagesPullingTime="3.932299752s" totalInitContainerRuntime="453.67423ms" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:09.693449431 +0000 UTC m=+341.530562268" watchObservedRunningTime="2026-11-03 17:35:09.695792711 +0000 UTC m=+341.532905534" Nov 03 17:35:13.811693 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.811659 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d"] Nov 03 17:35:13.815082 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.815065 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:13.832645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.832624 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wddpx\"" Nov 03 17:35:13.850100 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.850061 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szz6n\" (UniqueName: \"kubernetes.io/projected/60b500e1-7297-43cc-b2c8-1a8a755c0f18-kube-api-access-szz6n\") pod \"authorino-operator-7b7bb4bc77-7cv8d\" (UID: \"60b500e1-7297-43cc-b2c8-1a8a755c0f18\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:13.872832 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.872795 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d"] Nov 03 17:35:13.950655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.950612 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szz6n\" (UniqueName: \"kubernetes.io/projected/60b500e1-7297-43cc-b2c8-1a8a755c0f18-kube-api-access-szz6n\") pod \"authorino-operator-7b7bb4bc77-7cv8d\" (UID: \"60b500e1-7297-43cc-b2c8-1a8a755c0f18\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:13.975805 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:13.975777 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szz6n\" (UniqueName: \"kubernetes.io/projected/60b500e1-7297-43cc-b2c8-1a8a755c0f18-kube-api-access-szz6n\") pod \"authorino-operator-7b7bb4bc77-7cv8d\" (UID: \"60b500e1-7297-43cc-b2c8-1a8a755c0f18\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:14.126430 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:14.126396 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:14.410993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:14.410967 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d"] Nov 03 17:35:14.412450 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:14.412417 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b500e1_7297_43cc_b2c8_1a8a755c0f18.slice/crio-051c1ca521f274ca277e859cdfea1038024acb881ec874caf1ed3be4e3b718be WatchSource:0}: Error finding container 051c1ca521f274ca277e859cdfea1038024acb881ec874caf1ed3be4e3b718be: Status 404 returned error can't find the container with id 051c1ca521f274ca277e859cdfea1038024acb881ec874caf1ed3be4e3b718be Nov 03 17:35:14.668268 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:14.668232 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" event={"ID":"4befb32e-0a5e-4bca-835c-934649c9b9fb","Type":"ContainerStarted","Data":"0ef79aca41e6d2b41bde7e6155c2b01ac0c9dc8812b41325d46ff1a90c812521"} Nov 03 17:35:14.672616 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:14.672533 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" event={"ID":"60b500e1-7297-43cc-b2c8-1a8a755c0f18","Type":"ContainerStarted","Data":"051c1ca521f274ca277e859cdfea1038024acb881ec874caf1ed3be4e3b718be"} Nov 03 17:35:14.709622 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:14.709526 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-hf6pb" podStartSLOduration=1.897512493 podStartE2EDuration="6.709511204s" totalImagesPullingTime="4.811998711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:14.708656334 +0000 UTC m=+346.545769158" watchObservedRunningTime="2026-11-03 17:35:14.709511204 +0000 UTC m=+346.546624029" Nov 03 17:35:16.286753 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.286709 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc"] Nov 03 17:35:16.329271 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.329237 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.335377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.335346 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc"] Nov 03 17:35:16.339874 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.339850 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt"] Nov 03 17:35:16.342480 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.342448 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nvvmb\"" Nov 03 17:35:16.362085 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.362061 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 03 17:35:16.362309 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.362286 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 03 17:35:16.372124 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.372094 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpw69\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-kube-api-access-fpw69\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.372271 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.372225 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.373708 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.373684 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt"] Nov 03 17:35:16.374035 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.373859 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.439854 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.439818 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kcvcj\"" Nov 03 17:35:16.473353 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.473305 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpw69\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-kube-api-access-fpw69\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.473527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.473397 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvt7\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-kube-api-access-2cvt7\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.473527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.473429 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.473527 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.473464 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.492817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.492779 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.511311 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.511280 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpw69\" (UniqueName: \"kubernetes.io/projected/62c0fb3a-50e9-4791-9255-9202dfd049c6-kube-api-access-fpw69\") pod \"cert-manager-webhook-5dbbbf75cc-55lxc\" (UID: \"62c0fb3a-50e9-4791-9255-9202dfd049c6\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.574443 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.574364 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvt7\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-kube-api-access-2cvt7\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.574443 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.574405 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.588103 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.588071 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvt7\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-kube-api-access-2cvt7\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.590019 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.589990 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ad7fd3-36a8-4f7b-a69f-dedabb08632f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-fxnnt\" (UID: \"58ad7fd3-36a8-4f7b-a69f-dedabb08632f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:16.674101 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.674059 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:16.723277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:16.723246 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" Nov 03 17:35:17.012961 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:17.012930 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc"] Nov 03 17:35:17.042809 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:17.042771 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62c0fb3a_50e9_4791_9255_9202dfd049c6.slice/crio-d330f041ccfdeb4fef86af1230c1eb9727747d5d11815eada53f2088cfdacca9 WatchSource:0}: Error finding container d330f041ccfdeb4fef86af1230c1eb9727747d5d11815eada53f2088cfdacca9: Status 404 returned error can't find the container with id d330f041ccfdeb4fef86af1230c1eb9727747d5d11815eada53f2088cfdacca9 Nov 03 17:35:17.049017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:17.048993 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt"] Nov 03 17:35:17.051369 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:17.051343 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58ad7fd3_36a8_4f7b_a69f_dedabb08632f.slice/crio-34e7cb4c96522cc59ceb9bccd5b5c713b6d9e8d4e6c5d7900942fb7ee1bc1f55 WatchSource:0}: Error finding container 34e7cb4c96522cc59ceb9bccd5b5c713b6d9e8d4e6c5d7900942fb7ee1bc1f55: Status 404 returned error can't find the container with id 34e7cb4c96522cc59ceb9bccd5b5c713b6d9e8d4e6c5d7900942fb7ee1bc1f55 Nov 03 17:35:17.688642 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:17.688604 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" event={"ID":"58ad7fd3-36a8-4f7b-a69f-dedabb08632f","Type":"ContainerStarted","Data":"34e7cb4c96522cc59ceb9bccd5b5c713b6d9e8d4e6c5d7900942fb7ee1bc1f55"} Nov 03 17:35:17.689709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:17.689676 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" event={"ID":"62c0fb3a-50e9-4791-9255-9202dfd049c6","Type":"ContainerStarted","Data":"d330f041ccfdeb4fef86af1230c1eb9727747d5d11815eada53f2088cfdacca9"} Nov 03 17:35:18.701321 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:18.701283 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" event={"ID":"60b500e1-7297-43cc-b2c8-1a8a755c0f18","Type":"ContainerStarted","Data":"80917e48d9babc091e548bab6318a65de34a9a224202b01963ccc1ebe8ec8d75"} Nov 03 17:35:18.701852 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:18.701739 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:18.760791 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:18.760480 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" podStartSLOduration=2.3737618129999998 podStartE2EDuration="5.76046052s" totalImagesPullingTime="3.386698707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:18.758798137 +0000 UTC m=+350.595910964" watchObservedRunningTime="2026-11-03 17:35:18.76046052 +0000 UTC m=+350.597573345" Nov 03 17:35:19.254417 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.252791 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw"] Nov 03 17:35:19.256698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.255599 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.274364 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.274318 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-vb8kq\"" Nov 03 17:35:19.275891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.275866 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 03 17:35:19.277817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.277791 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 03 17:35:19.279189 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.279164 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw"] Nov 03 17:35:19.299481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.299413 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjg5z\" (UniqueName: \"kubernetes.io/projected/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-kube-api-access-vjg5z\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.299481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.299470 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-tmp\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.400820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.400071 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-tmp\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.400820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.400214 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjg5z\" (UniqueName: \"kubernetes.io/projected/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-kube-api-access-vjg5z\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.401028 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.400958 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-tmp\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.428670 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:35:19.428625 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:35:19.443098 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.443068 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjg5z\" (UniqueName: \"kubernetes.io/projected/c532d758-aeaf-4711-9cf9-80e4b9eb5dfd-kube-api-access-vjg5z\") pod \"jobset-operator-674cd59dc5-rhphw\" (UID: \"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.571142 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.570873 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" Nov 03 17:35:19.971272 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:19.971171 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw"] Nov 03 17:35:19.979254 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:19.979216 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc532d758_aeaf_4711_9cf9_80e4b9eb5dfd.slice/crio-6ebebaf515cb99b6599dc525ede17a52f7c33d1d370f38dfd55d47b678325a77 WatchSource:0}: Error finding container 6ebebaf515cb99b6599dc525ede17a52f7c33d1d370f38dfd55d47b678325a77: Status 404 returned error can't find the container with id 6ebebaf515cb99b6599dc525ede17a52f7c33d1d370f38dfd55d47b678325a77 Nov 03 17:35:20.650934 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:20.650900 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f494f769f-hxpbv" Nov 03 17:35:20.713830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:20.713792 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" event={"ID":"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd","Type":"ContainerStarted","Data":"6ebebaf515cb99b6599dc525ede17a52f7c33d1d370f38dfd55d47b678325a77"} Nov 03 17:35:21.721916 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:21.721826 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" event={"ID":"58ad7fd3-36a8-4f7b-a69f-dedabb08632f","Type":"ContainerStarted","Data":"7d6a97c68c07de2ed5f31eb0b54f44a3e7643e489ba3b7b3eb80c5411259619e"} Nov 03 17:35:21.724634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:21.724602 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" event={"ID":"62c0fb3a-50e9-4791-9255-9202dfd049c6","Type":"ContainerStarted","Data":"1dba3c24b8b3ae6c75da987d6214da386e1a13c845b87ce067b8c75d71499898"} Nov 03 17:35:21.725325 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:21.725305 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:21.763600 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:21.763526 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-fxnnt" podStartSLOduration=1.432116543 podStartE2EDuration="5.763505157s" totalImagesPullingTime="4.331388614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:21.761761605 +0000 UTC m=+353.598874429" watchObservedRunningTime="2026-11-03 17:35:21.763505157 +0000 UTC m=+353.600617984" Nov 03 17:35:21.798073 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:21.797997 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" podStartSLOduration=1.6575177989999998 podStartE2EDuration="5.797978874s" totalImagesPullingTime="4.140461075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:21.79705064 +0000 UTC m=+353.634163466" watchObservedRunningTime="2026-11-03 17:35:21.797978874 +0000 UTC m=+353.635091700" Nov 03 17:35:23.735153 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:23.735116 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" event={"ID":"c532d758-aeaf-4711-9cf9-80e4b9eb5dfd","Type":"ContainerStarted","Data":"dd61e341366d89a4328567f49d3a371bbae1992782cfef33b5cdf218ba5446ae"} Nov 03 17:35:23.779367 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:23.779311 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-rhphw" podStartSLOduration=1.4387227249999999 podStartE2EDuration="4.779294531s" totalImagesPullingTime="3.340571806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:23.779060162 +0000 UTC m=+355.616172976" watchObservedRunningTime="2026-11-03 17:35:23.779294531 +0000 UTC m=+355.616407355" Nov 03 17:35:28.737429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:28.737391 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-55lxc" Nov 03 17:35:29.710093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:29.710056 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-7cv8d" Nov 03 17:35:38.588408 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.588363 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w"] Nov 03 17:35:38.593231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.593208 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.609632 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.609551 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2rn85\"" Nov 03 17:35:38.609763 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.609748 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Nov 03 17:35:38.611358 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.611336 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w"] Nov 03 17:35:38.613249 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.613226 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 17:35:38.613338 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.613295 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 03 17:35:38.613338 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.613291 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 17:35:38.669723 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.669686 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bsx\" (UniqueName: \"kubernetes.io/projected/c7f1a5e3-8601-4f97-a279-925e88d47347-kube-api-access-24bsx\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.669723 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.669731 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f1a5e3-8601-4f97-a279-925e88d47347-tmp\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.669937 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.669827 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f1a5e3-8601-4f97-a279-925e88d47347-tls-certs\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.770748 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.770691 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f1a5e3-8601-4f97-a279-925e88d47347-tls-certs\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.770927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.770766 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bsx\" (UniqueName: \"kubernetes.io/projected/c7f1a5e3-8601-4f97-a279-925e88d47347-kube-api-access-24bsx\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.770927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.770884 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f1a5e3-8601-4f97-a279-925e88d47347-tmp\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.773098 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.773069 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f1a5e3-8601-4f97-a279-925e88d47347-tmp\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.773412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.773387 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f1a5e3-8601-4f97-a279-925e88d47347-tls-certs\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.797854 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.797828 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bsx\" (UniqueName: \"kubernetes.io/projected/c7f1a5e3-8601-4f97-a279-925e88d47347-kube-api-access-24bsx\") pod \"kube-auth-proxy-77d87c9759-b8z5w\" (UID: \"c7f1a5e3-8601-4f97-a279-925e88d47347\") " pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:38.905291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:38.905218 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" Nov 03 17:35:39.194743 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:39.194716 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w"] Nov 03 17:35:39.197185 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:39.197153 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f1a5e3_8601_4f97_a279_925e88d47347.slice/crio-5c2f49c92b3386bb090b3474f3c66bda136aee4d82c33df2043fe1eefe952909 WatchSource:0}: Error finding container 5c2f49c92b3386bb090b3474f3c66bda136aee4d82c33df2043fe1eefe952909: Status 404 returned error can't find the container with id 5c2f49c92b3386bb090b3474f3c66bda136aee4d82c33df2043fe1eefe952909 Nov 03 17:35:39.802703 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:39.802667 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" event={"ID":"c7f1a5e3-8601-4f97-a279-925e88d47347","Type":"ContainerStarted","Data":"5c2f49c92b3386bb090b3474f3c66bda136aee4d82c33df2043fe1eefe952909"} Nov 03 17:35:42.818768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:42.818729 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" event={"ID":"c7f1a5e3-8601-4f97-a279-925e88d47347","Type":"ContainerStarted","Data":"452ddbd187a8cdb3491f60aa3a950e338e63c3bb74ade8b6d7814fbca16490c1"} Nov 03 17:35:42.839913 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:42.839856 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77d87c9759-b8z5w" podStartSLOduration=2.064859016 podStartE2EDuration="4.839841013s" totalImagesPullingTime="2.774981997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:42.838286225 +0000 UTC m=+374.675399051" watchObservedRunningTime="2026-11-03 17:35:42.839841013 +0000 UTC m=+374.676953836" Nov 03 17:35:49.415325 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:35:49.415284 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:35:49.775106 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:49.775068 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:35:49.793680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:49.793648 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:35:49.793859 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:49.793744 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:35:49.824727 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:49.824697 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-psmbv\"" Nov 03 17:35:49.968408 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:49.968375 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtddn\" (UniqueName: \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\") pod \"authorino-56c6c9ddd5-v6tg2\" (UID: \"768afcd9-0d45-4d1a-8e41-051f94fd2ac9\") " pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:35:50.069219 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:50.069110 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtddn\" (UniqueName: \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\") pod \"authorino-56c6c9ddd5-v6tg2\" (UID: \"768afcd9-0d45-4d1a-8e41-051f94fd2ac9\") " pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:35:50.082452 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:50.082419 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtddn\" (UniqueName: \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\") pod \"authorino-56c6c9ddd5-v6tg2\" (UID: \"768afcd9-0d45-4d1a-8e41-051f94fd2ac9\") " pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:35:50.104410 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:50.104377 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:35:50.375650 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:50.375620 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:35:50.378097 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:50.378056 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod768afcd9_0d45_4d1a_8e41_051f94fd2ac9.slice/crio-acec449540e9610cdac4e8727b52fb9f53da0cac726e1421e842ab7083efabb0 WatchSource:0}: Error finding container acec449540e9610cdac4e8727b52fb9f53da0cac726e1421e842ab7083efabb0: Status 404 returned error can't find the container with id acec449540e9610cdac4e8727b52fb9f53da0cac726e1421e842ab7083efabb0 Nov 03 17:35:50.852261 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:50.852219 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" event={"ID":"768afcd9-0d45-4d1a-8e41-051f94fd2ac9","Type":"ContainerStarted","Data":"acec449540e9610cdac4e8727b52fb9f53da0cac726e1421e842ab7083efabb0"} Nov 03 17:35:52.862645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:52.862602 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" event={"ID":"768afcd9-0d45-4d1a-8e41-051f94fd2ac9","Type":"ContainerStarted","Data":"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491"} Nov 03 17:35:52.879897 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:52.879844 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" podStartSLOduration=1.6102467919999999 podStartE2EDuration="3.879829755s" totalImagesPullingTime="2.269582963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:52.879330092 +0000 UTC m=+384.716442917" watchObservedRunningTime="2026-11-03 17:35:52.879829755 +0000 UTC m=+384.716942580" Nov 03 17:35:57.765840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.765802 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm"] Nov 03 17:35:57.772256 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.772231 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.781447 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.781418 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Nov 03 17:35:57.782086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.782057 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Nov 03 17:35:57.782191 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.782133 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm"] Nov 03 17:35:57.782296 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.782279 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-scldv\"" Nov 03 17:35:57.783026 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.783000 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Nov 03 17:35:57.841186 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.841146 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-manager-config\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.841360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.841212 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-cert\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.841360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.841318 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkvb\" (UniqueName: \"kubernetes.io/projected/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-kube-api-access-dlkvb\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.841458 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.841389 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-metrics-certs\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.942236 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.942192 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-cert\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.942444 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.942257 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkvb\" (UniqueName: \"kubernetes.io/projected/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-kube-api-access-dlkvb\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.942444 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.942308 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-metrics-certs\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.942444 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.942345 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-manager-config\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.943036 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.943012 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-manager-config\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.944821 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.944790 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-metrics-certs\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.944932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.944823 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-cert\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:57.958152 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:57.958125 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkvb\" (UniqueName: \"kubernetes.io/projected/0eb80c9e-3915-4f4f-92c7-e94d70d0c65f-kube-api-access-dlkvb\") pod \"jobset-controller-manager-65fbc5dc-2xxbm\" (UID: \"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f\") " pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:58.086309 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:58.086223 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:35:58.360725 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:58.360698 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm"] Nov 03 17:35:58.362976 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:35:58.362950 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb80c9e_3915_4f4f_92c7_e94d70d0c65f.slice/crio-be2a109cbfbdcd9737dfee82e17e662374c372edbb2c265ae11903222d1a8c2f WatchSource:0}: Error finding container be2a109cbfbdcd9737dfee82e17e662374c372edbb2c265ae11903222d1a8c2f: Status 404 returned error can't find the container with id be2a109cbfbdcd9737dfee82e17e662374c372edbb2c265ae11903222d1a8c2f Nov 03 17:35:58.890182 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:35:58.890144 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" event={"ID":"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f","Type":"ContainerStarted","Data":"be2a109cbfbdcd9737dfee82e17e662374c372edbb2c265ae11903222d1a8c2f"} Nov 03 17:36:01.905776 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:36:01.905680 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" event={"ID":"0eb80c9e-3915-4f4f-92c7-e94d70d0c65f","Type":"ContainerStarted","Data":"0ed1df287d1aeb25b3e0c1a0cb4a671a066339c98050794b96f1661874f62bd6"} Nov 03 17:36:01.906141 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:36:01.905778 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:36:01.926892 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:36:01.926839 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" podStartSLOduration=1.690639112 podStartE2EDuration="4.926824113s" totalImagesPullingTime="3.236185001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:36:01.924896673 +0000 UTC m=+393.762009497" watchObservedRunningTime="2026-11-03 17:36:01.926824113 +0000 UTC m=+393.763936936" Nov 03 17:36:12.915252 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:36:12.915176 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-65fbc5dc-2xxbm" Nov 03 17:36:19.414319 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:36:19.414276 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:36:49.415788 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:36:49.415749 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:37:19.414444 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:37:19.414404 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:37:49.414713 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:37:49.414676 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:38:19.414996 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:38:19.414950 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:38:34.107079 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.107045 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-gswwr"] Nov 03 17:38:34.109821 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.109803 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.127312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.127286 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 03 17:38:34.127969 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.127949 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-gswwr"] Nov 03 17:38:34.149489 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.149450 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-gswwr"] Nov 03 17:38:34.149679 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:38:34.149659 4557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-68x5r tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-68x5r tls-cert]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-gswwr" podUID="bacfd069-be8e-46fc-8c12-cb40bea6af39" Nov 03 17:38:34.188164 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.188134 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68x5r\" (UniqueName: \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.188352 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.188183 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.188409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.188376 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:34.191322 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.191306 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.202073 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.202047 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:34.289311 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.289277 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68x5r\" (UniqueName: \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.289311 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.289322 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.289516 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.289350 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbx2\" (UniqueName: \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.289516 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.289458 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.292030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.292005 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.308299 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.308268 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68x5r\" (UniqueName: \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\") pod \"authorino-6dd76875b5-gswwr\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.390485 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.390392 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbx2\" (UniqueName: \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.390671 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.390502 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.392953 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.392932 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.403650 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.403624 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbx2\" (UniqueName: \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\") pod \"authorino-6889cbd8c4-ngxss\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.502723 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.502686 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:34.504606 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.504576 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:34.588481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.588450 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.595393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.595369 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:34.693087 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.693040 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\" (UniqueName: \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\") pod \"bacfd069-be8e-46fc-8c12-cb40bea6af39\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " Nov 03 17:38:34.693283 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.693114 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\" (UniqueName: \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\") pod \"bacfd069-be8e-46fc-8c12-cb40bea6af39\" (UID: \"bacfd069-be8e-46fc-8c12-cb40bea6af39\") " Nov 03 17:38:34.695075 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.695045 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert" pod "bacfd069-be8e-46fc-8c12-cb40bea6af39" (UID: "bacfd069-be8e-46fc-8c12-cb40bea6af39"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:38:34.695180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.695118 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r" pod "bacfd069-be8e-46fc-8c12-cb40bea6af39" (UID: "bacfd069-be8e-46fc-8c12-cb40bea6af39"). InnerVolumeSpecName "kube-api-access-68x5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:38:34.774101 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.774029 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:34.776268 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:38:34.776240 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d691d8a_f907_4317_b652_71e91d9141a7.slice/crio-d83025549675c60efa799539113361226489459d9d5e35866001b3dbf8b8e9f2 WatchSource:0}: Error finding container d83025549675c60efa799539113361226489459d9d5e35866001b3dbf8b8e9f2: Status 404 returned error can't find the container with id d83025549675c60efa799539113361226489459d9d5e35866001b3dbf8b8e9f2 Nov 03 17:38:34.794105 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.794079 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68x5r\" (UniqueName: \"kubernetes.io/projected/bacfd069-be8e-46fc-8c12-cb40bea6af39-kube-api-access-68x5r\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:38:34.794105 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:34.794104 4557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bacfd069-be8e-46fc-8c12-cb40bea6af39-tls-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:38:35.593762 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:35.593691 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-gswwr" Nov 03 17:38:35.593762 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:35.593702 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" event={"ID":"7d691d8a-f907-4317-b652-71e91d9141a7","Type":"ContainerStarted","Data":"d83025549675c60efa799539113361226489459d9d5e35866001b3dbf8b8e9f2"} Nov 03 17:38:35.634087 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:35.634055 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-gswwr"] Nov 03 17:38:35.640308 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:35.640280 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-gswwr"] Nov 03 17:38:36.321368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:36.321335 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bacfd069-be8e-46fc-8c12-cb40bea6af39" path="/var/lib/kubelet/pods/bacfd069-be8e-46fc-8c12-cb40bea6af39/volumes" Nov 03 17:38:36.824742 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:36.824711 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:38:36.825200 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:36.824921 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" podUID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" containerName="authorino" containerID="cri-o://4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491" gracePeriod=30 Nov 03 17:38:37.090519 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.090493 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:38:37.114541 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.114511 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\" (UniqueName: \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\") pod \"768afcd9-0d45-4d1a-8e41-051f94fd2ac9\" (UID: \"768afcd9-0d45-4d1a-8e41-051f94fd2ac9\") " Nov 03 17:38:37.117092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.117058 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn" pod "768afcd9-0d45-4d1a-8e41-051f94fd2ac9" (UID: "768afcd9-0d45-4d1a-8e41-051f94fd2ac9"). InnerVolumeSpecName "kube-api-access-dtddn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:38:37.215412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.215329 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtddn\" (UniqueName: \"kubernetes.io/projected/768afcd9-0d45-4d1a-8e41-051f94fd2ac9-kube-api-access-dtddn\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:38:37.603180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.603093 4557 generic.go:356] "Generic (PLEG): container finished" podID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" containerID="4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491" exitCode=0 Nov 03 17:38:37.603180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.603133 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" Nov 03 17:38:37.603180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.603140 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" event={"ID":"768afcd9-0d45-4d1a-8e41-051f94fd2ac9","Type":"ContainerDied","Data":"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491"} Nov 03 17:38:37.603435 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.603184 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-v6tg2" event={"ID":"768afcd9-0d45-4d1a-8e41-051f94fd2ac9","Type":"ContainerDied","Data":"acec449540e9610cdac4e8727b52fb9f53da0cac726e1421e842ab7083efabb0"} Nov 03 17:38:37.603435 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.603209 4557 scope.go:122] "RemoveContainer" containerID="4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491" Nov 03 17:38:37.604838 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.604806 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" event={"ID":"7d691d8a-f907-4317-b652-71e91d9141a7","Type":"ContainerStarted","Data":"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1"} Nov 03 17:38:37.604995 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.604972 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" podUID="7d691d8a-f907-4317-b652-71e91d9141a7" containerName="authorino" containerID="cri-o://a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1" gracePeriod=30 Nov 03 17:38:37.613410 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.613389 4557 scope.go:122] "RemoveContainer" containerID="4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491" Nov 03 17:38:37.613802 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:38:37.613773 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491\": container with ID starting with 4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491 not found: ID does not exist" containerID="4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491" Nov 03 17:38:37.613891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.613816 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491"} err="failed to get container status \"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491\": rpc error: code = NotFound desc = could not find container \"4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491\": container with ID starting with 4daf995d20626eaa817238674fa2cfdb5050f6c9a9e044e6d3a4567688a3f491 not found: ID does not exist" Nov 03 17:38:37.626363 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.626318 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" podStartSLOduration=1.749652094 podStartE2EDuration="3.626305456s" totalImagesPullingTime="1.876653362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:38:37.625417113 +0000 UTC m=+549.462529940" watchObservedRunningTime="2026-11-03 17:38:37.626305456 +0000 UTC m=+549.463418285" Nov 03 17:38:37.641949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.641922 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:38:37.649633 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.649600 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-v6tg2"] Nov 03 17:38:37.848868 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.848842 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:37.921315 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.921283 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\" (UniqueName: \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\") pod \"7d691d8a-f907-4317-b652-71e91d9141a7\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " Nov 03 17:38:37.921476 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.921353 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\" (UniqueName: \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\") pod \"7d691d8a-f907-4317-b652-71e91d9141a7\" (UID: \"7d691d8a-f907-4317-b652-71e91d9141a7\") " Nov 03 17:38:37.923464 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.923422 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2" pod "7d691d8a-f907-4317-b652-71e91d9141a7" (UID: "7d691d8a-f907-4317-b652-71e91d9141a7"). InnerVolumeSpecName "kube-api-access-dfbx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:38:37.930754 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:37.930729 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert" pod "7d691d8a-f907-4317-b652-71e91d9141a7" (UID: "7d691d8a-f907-4317-b652-71e91d9141a7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:38:38.022217 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.022174 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfbx2\" (UniqueName: \"kubernetes.io/projected/7d691d8a-f907-4317-b652-71e91d9141a7-kube-api-access-dfbx2\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:38:38.022217 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.022212 4557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d691d8a-f907-4317-b652-71e91d9141a7-tls-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:38:38.321987 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.321911 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" path="/var/lib/kubelet/pods/768afcd9-0d45-4d1a-8e41-051f94fd2ac9/volumes" Nov 03 17:38:38.610629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.610528 4557 generic.go:356] "Generic (PLEG): container finished" podID="7d691d8a-f907-4317-b652-71e91d9141a7" containerID="a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1" exitCode=0 Nov 03 17:38:38.610629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.610583 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" Nov 03 17:38:38.610629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.610607 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" event={"ID":"7d691d8a-f907-4317-b652-71e91d9141a7","Type":"ContainerDied","Data":"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1"} Nov 03 17:38:38.610872 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.610649 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ngxss" event={"ID":"7d691d8a-f907-4317-b652-71e91d9141a7","Type":"ContainerDied","Data":"d83025549675c60efa799539113361226489459d9d5e35866001b3dbf8b8e9f2"} Nov 03 17:38:38.610872 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.610666 4557 scope.go:122] "RemoveContainer" containerID="a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1" Nov 03 17:38:38.618741 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.618723 4557 scope.go:122] "RemoveContainer" containerID="a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1" Nov 03 17:38:38.619004 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:38:38.618986 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1\": container with ID starting with a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1 not found: ID does not exist" containerID="a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1" Nov 03 17:38:38.619050 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.619012 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1"} err="failed to get container status \"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1\": rpc error: code = NotFound desc = could not find container \"a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1\": container with ID starting with a80bb890f1a68b1cde45b178ed7e10743506e76fceb94acdb9ec526f038559a1 not found: ID does not exist" Nov 03 17:38:38.633675 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.633649 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:38.640613 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:38.640588 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ngxss"] Nov 03 17:38:40.321611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:38:40.321559 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d691d8a-f907-4317-b652-71e91d9141a7" path="/var/lib/kubelet/pods/7d691d8a-f907-4317-b652-71e91d9141a7/volumes" Nov 03 17:38:49.414552 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:38:49.414515 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:39:19.414732 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:39:19.414653 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:39:19.772837 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.772802 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:39:19.773120 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773107 4557 cpu_manager.go:414] "containerMap: removing container" podUID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" containerName="authorino" Nov 03 17:39:19.773164 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773122 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" containerName="authorino" Nov 03 17:39:19.773164 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773137 4557 cpu_manager.go:414] "containerMap: removing container" podUID="7d691d8a-f907-4317-b652-71e91d9141a7" containerName="authorino" Nov 03 17:39:19.773164 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773143 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d691d8a-f907-4317-b652-71e91d9141a7" containerName="authorino" Nov 03 17:39:19.773252 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773197 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="768afcd9-0d45-4d1a-8e41-051f94fd2ac9" containerName="authorino" Nov 03 17:39:19.773252 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.773206 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d691d8a-f907-4317-b652-71e91d9141a7" containerName="authorino" Nov 03 17:39:19.775969 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.775954 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.785077 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.785056 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 03 17:39:19.796536 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.796511 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:39:19.798620 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.798597 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Nov 03 17:39:19.869761 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.869725 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.869950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.869781 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.869950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.869884 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdf4m\" (UniqueName: \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.885344 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.885318 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-psmbv\"" Nov 03 17:39:19.970907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.970860 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.971083 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.970927 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdf4m\" (UniqueName: \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.971083 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.970964 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.971592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.971542 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.973304 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.973265 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:19.984054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:19.984027 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdf4m\" (UniqueName: \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\") pod \"authorino-67c5b6ccdd-zfmwx\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:20.088041 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:20.087957 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:39:20.367304 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:20.367279 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:39:20.369765 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:39:20.369743 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8b30425_64d7_4792_99f7_fd4a4ebf5ebb.slice/crio-2609a42502e5aed0e6ee4bc5247c1897c84a68e5ef9de12d176fbdb27de234ea WatchSource:0}: Error finding container 2609a42502e5aed0e6ee4bc5247c1897c84a68e5ef9de12d176fbdb27de234ea: Status 404 returned error can't find the container with id 2609a42502e5aed0e6ee4bc5247c1897c84a68e5ef9de12d176fbdb27de234ea Nov 03 17:39:20.796173 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:20.796133 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" event={"ID":"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb","Type":"ContainerStarted","Data":"2609a42502e5aed0e6ee4bc5247c1897c84a68e5ef9de12d176fbdb27de234ea"} Nov 03 17:39:21.802460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:21.802421 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" event={"ID":"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb","Type":"ContainerStarted","Data":"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b"} Nov 03 17:39:21.829607 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:21.829539 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" podStartSLOduration=2.17959556 podStartE2EDuration="2.829526456s" totalImagesPullingTime="649.930896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:39:21.827434432 +0000 UTC m=+593.664547268" watchObservedRunningTime="2026-11-03 17:39:21.829526456 +0000 UTC m=+593.666639318" Nov 03 17:39:28.399293 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:28.399269 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:39:28.400431 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:39:28.400413 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:39:49.414334 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:39:49.414293 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:40:14.921950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.921910 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:14.925292 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.925271 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:14.933239 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.933206 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 17:40:14.933239 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.933218 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-ch7x7\"" Nov 03 17:40:14.933425 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.933259 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 03 17:40:14.934520 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.934491 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 17:40:14.934921 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.934903 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 03 17:40:14.937108 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:14.937086 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:15.042671 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.042633 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gglcx\" (UniqueName: \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.042844 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.042771 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.144095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.144052 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.144095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.144095 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gglcx\" (UniqueName: \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.146521 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.146489 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.157024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.156999 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gglcx\" (UniqueName: \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\") pod \"ai-gateway-controller-5d8dddb676-gjkjf\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.238391 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.238300 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:15.514386 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.514359 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:15.517100 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:40:15.517073 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e127d5c_8096_4a72_b11f_76049e800b88.slice/crio-a48d60518b6ec5b62213a0121e737b6692bdf80c877c9c67d29d2f496c8148dd WatchSource:0}: Error finding container a48d60518b6ec5b62213a0121e737b6692bdf80c877c9c67d29d2f496c8148dd: Status 404 returned error can't find the container with id a48d60518b6ec5b62213a0121e737b6692bdf80c877c9c67d29d2f496c8148dd Nov 03 17:40:15.518821 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:15.518799 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:40:16.037332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:16.037293 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" event={"ID":"3e127d5c-8096-4a72-b11f-76049e800b88","Type":"ContainerStarted","Data":"a48d60518b6ec5b62213a0121e737b6692bdf80c877c9c67d29d2f496c8148dd"} Nov 03 17:40:19.052200 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:19.052155 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" event={"ID":"3e127d5c-8096-4a72-b11f-76049e800b88","Type":"ContainerStarted","Data":"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497"} Nov 03 17:40:19.052603 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:19.052293 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:19.072852 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:19.072797 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" podStartSLOduration=2.421693297 podStartE2EDuration="5.072782502s" totalImagesPullingTime="2.651089205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:19.071434837 +0000 UTC m=+650.908547673" watchObservedRunningTime="2026-11-03 17:40:19.072782502 +0000 UTC m=+650.909895325" Nov 03 17:40:19.414245 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:40:19.414158 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:40:20.175101 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.175068 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-qq4w2"] Nov 03 17:40:20.178263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.178242 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-qdds7"] Nov 03 17:40:20.178399 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.178376 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.181314 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.181296 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.186639 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.186611 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2v4w\"" Nov 03 17:40:20.189231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.189208 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Nov 03 17:40:20.196288 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.195950 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-qq4w2"] Nov 03 17:40:20.198601 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.198559 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-qdds7"] Nov 03 17:40:20.288016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.287982 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-kube-api-access-qzj7v\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.288198 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.288036 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpz4h\" (UniqueName: \"kubernetes.io/projected/88d8de8b-057e-49e9-84bb-ec619d90d768-kube-api-access-gpz4h\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.288198 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.288058 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.288198 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.288163 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d8de8b-057e-49e9-84bb-ec619d90d768-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.389616 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.389555 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-kube-api-access-qzj7v\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.389803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.389647 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpz4h\" (UniqueName: \"kubernetes.io/projected/88d8de8b-057e-49e9-84bb-ec619d90d768-kube-api-access-gpz4h\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.389803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.389674 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.389803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.389713 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d8de8b-057e-49e9-84bb-ec619d90d768-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.390434 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.390411 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.390481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.390447 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d8de8b-057e-49e9-84bb-ec619d90d768-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.405928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.405904 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/374f1edb-d1ac-45c8-8cbb-ef8e776f8120-kube-api-access-qzj7v\") pod \"payload-processing-55fbbbf9dc-qq4w2\" (UID: \"374f1edb-d1ac-45c8-8cbb-ef8e776f8120\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.406334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.406316 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpz4h\" (UniqueName: \"kubernetes.io/projected/88d8de8b-057e-49e9-84bb-ec619d90d768-kube-api-access-gpz4h\") pod \"payload-pre-processing-7b98bb678c-qdds7\" (UID: \"88d8de8b-057e-49e9-84bb-ec619d90d768\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.493474 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.493378 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:20.504597 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.504544 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:20.769422 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.769396 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-qq4w2"] Nov 03 17:40:20.771864 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:40:20.771831 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374f1edb_d1ac_45c8_8cbb_ef8e776f8120.slice/crio-0af3904315bcdaa9cf0f64db55c4813b2487e08e522916b223760abb6f1b1d23 WatchSource:0}: Error finding container 0af3904315bcdaa9cf0f64db55c4813b2487e08e522916b223760abb6f1b1d23: Status 404 returned error can't find the container with id 0af3904315bcdaa9cf0f64db55c4813b2487e08e522916b223760abb6f1b1d23 Nov 03 17:40:20.793214 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:20.793151 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-qdds7"] Nov 03 17:40:20.795248 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:40:20.795221 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d8de8b_057e_49e9_84bb_ec619d90d768.slice/crio-e4a06d5c549cdd1a7092c26f1a6f9b0e321e198e1e816082b510bf0e055056c5 WatchSource:0}: Error finding container e4a06d5c549cdd1a7092c26f1a6f9b0e321e198e1e816082b510bf0e055056c5: Status 404 returned error can't find the container with id e4a06d5c549cdd1a7092c26f1a6f9b0e321e198e1e816082b510bf0e055056c5 Nov 03 17:40:21.063377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:21.063292 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" event={"ID":"88d8de8b-057e-49e9-84bb-ec619d90d768","Type":"ContainerStarted","Data":"e4a06d5c549cdd1a7092c26f1a6f9b0e321e198e1e816082b510bf0e055056c5"} Nov 03 17:40:21.064398 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:21.064372 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" event={"ID":"374f1edb-d1ac-45c8-8cbb-ef8e776f8120","Type":"ContainerStarted","Data":"0af3904315bcdaa9cf0f64db55c4813b2487e08e522916b223760abb6f1b1d23"} Nov 03 17:40:23.075978 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.075951 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" event={"ID":"88d8de8b-057e-49e9-84bb-ec619d90d768","Type":"ContainerStarted","Data":"0b5f1e3518d187bfe2c6eb82130bac37d942659f91a53c22bc38167df40d0b9d"} Nov 03 17:40:23.076421 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.076400 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:23.077439 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.077419 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" event={"ID":"374f1edb-d1ac-45c8-8cbb-ef8e776f8120","Type":"ContainerStarted","Data":"adf7501901c2c3cda31d9663205b44e03c12dfcd483c20120b2d61c34b1b752a"} Nov 03 17:40:23.077529 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.077460 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:23.095497 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.095268 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" podStartSLOduration=0.880169419 podStartE2EDuration="3.095251956s" totalImagesPullingTime="2.215082537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:23.094978894 +0000 UTC m=+654.932091719" watchObservedRunningTime="2026-11-03 17:40:23.095251956 +0000 UTC m=+654.932364782" Nov 03 17:40:23.116722 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:23.116667 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" podStartSLOduration=0.885956745 podStartE2EDuration="3.116556829s" totalImagesPullingTime="2.230600084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:23.114995961 +0000 UTC m=+654.952108786" watchObservedRunningTime="2026-11-03 17:40:23.116556829 +0000 UTC m=+654.953669653" Nov 03 17:40:30.060184 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:30.060152 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:34.085536 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:34.085509 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-qdds7" Nov 03 17:40:34.085946 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:34.085586 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-qq4w2" Nov 03 17:40:43.501021 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.500936 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:43.501412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.501164 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" podUID="3e127d5c-8096-4a72-b11f-76049e800b88" containerName="manager" containerID="cri-o://315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497" gracePeriod=30 Nov 03 17:40:43.744099 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.744071 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:43.783086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.783003 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\") pod \"3e127d5c-8096-4a72-b11f-76049e800b88\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " Nov 03 17:40:43.783247 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.783198 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\" (UniqueName: \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\") pod \"3e127d5c-8096-4a72-b11f-76049e800b88\" (UID: \"3e127d5c-8096-4a72-b11f-76049e800b88\") " Nov 03 17:40:43.785254 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.785222 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx" pod "3e127d5c-8096-4a72-b11f-76049e800b88" (UID: "3e127d5c-8096-4a72-b11f-76049e800b88"). InnerVolumeSpecName "kube-api-access-gglcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:40:43.785370 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.785302 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs" pod "3e127d5c-8096-4a72-b11f-76049e800b88" (UID: "3e127d5c-8096-4a72-b11f-76049e800b88"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:40:43.884634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.884599 4557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e127d5c-8096-4a72-b11f-76049e800b88-metrics-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:40:43.884634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:43.884629 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gglcx\" (UniqueName: \"kubernetes.io/projected/3e127d5c-8096-4a72-b11f-76049e800b88-kube-api-access-gglcx\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:40:44.175378 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.175339 4557 generic.go:356] "Generic (PLEG): container finished" podID="3e127d5c-8096-4a72-b11f-76049e800b88" containerID="315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497" exitCode=0 Nov 03 17:40:44.175581 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.175385 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" event={"ID":"3e127d5c-8096-4a72-b11f-76049e800b88","Type":"ContainerDied","Data":"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497"} Nov 03 17:40:44.175581 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.175427 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" event={"ID":"3e127d5c-8096-4a72-b11f-76049e800b88","Type":"ContainerDied","Data":"a48d60518b6ec5b62213a0121e737b6692bdf80c877c9c67d29d2f496c8148dd"} Nov 03 17:40:44.175581 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.175450 4557 scope.go:122] "RemoveContainer" containerID="315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497" Nov 03 17:40:44.175581 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.175386 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-gjkjf" Nov 03 17:40:44.184971 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.184947 4557 scope.go:122] "RemoveContainer" containerID="315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497" Nov 03 17:40:44.185234 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:40:44.185216 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497\": container with ID starting with 315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497 not found: ID does not exist" containerID="315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497" Nov 03 17:40:44.185298 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.185241 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497"} err="failed to get container status \"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497\": rpc error: code = NotFound desc = could not find container \"315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497\": container with ID starting with 315de2f6d00b133202ce7b4d50c3e3518c4779c239910a6d21f5f8b9525a4497 not found: ID does not exist" Nov 03 17:40:44.199318 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.199289 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:44.203913 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.203888 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-gjkjf"] Nov 03 17:40:44.321403 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:44.321372 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e127d5c-8096-4a72-b11f-76049e800b88" path="/var/lib/kubelet/pods/3e127d5c-8096-4a72-b11f-76049e800b88/volumes" Nov 03 17:40:49.415722 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:40:49.415686 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:40:54.927391 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.927355 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9"] Nov 03 17:40:54.927890 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.927709 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3e127d5c-8096-4a72-b11f-76049e800b88" containerName="manager" Nov 03 17:40:54.927890 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.927721 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e127d5c-8096-4a72-b11f-76049e800b88" containerName="manager" Nov 03 17:40:54.927890 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.927796 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e127d5c-8096-4a72-b11f-76049e800b88" containerName="manager" Nov 03 17:40:54.936458 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.936434 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.948669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.948648 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 03 17:40:54.949756 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.949735 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 03 17:40:54.950320 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.950290 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Nov 03 17:40:54.950461 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.950447 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hs96m\"" Nov 03 17:40:54.951604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.951583 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9"] Nov 03 17:40:54.984149 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984118 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.984332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984172 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.984332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984226 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.984450 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984337 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwsw\" (UniqueName: \"kubernetes.io/projected/2f29a52b-7a08-4087-bce5-98ac64c3cff6-kube-api-access-tzwsw\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.984450 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984383 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:54.984450 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:54.984418 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085462 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085414 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085462 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085465 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085493 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwsw\" (UniqueName: \"kubernetes.io/projected/2f29a52b-7a08-4087-bce5-98ac64c3cff6-kube-api-access-tzwsw\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085522 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085543 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085635 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085991 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085851 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.085991 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085918 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.086073 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.085991 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.087859 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.087838 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f29a52b-7a08-4087-bce5-98ac64c3cff6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.088030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.088009 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f29a52b-7a08-4087-bce5-98ac64c3cff6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.098320 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.098292 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwsw\" (UniqueName: \"kubernetes.io/projected/2f29a52b-7a08-4087-bce5-98ac64c3cff6-kube-api-access-tzwsw\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hqsx9\" (UID: \"2f29a52b-7a08-4087-bce5-98ac64c3cff6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.248818 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.248729 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:55.524415 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:55.524384 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9"] Nov 03 17:40:55.525811 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:40:55.525781 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f29a52b_7a08_4087_bce5_98ac64c3cff6.slice/crio-b939ce53a77f1817505cb419da37c7c6f8261956b4bca150184b466fffe8e3b9 WatchSource:0}: Error finding container b939ce53a77f1817505cb419da37c7c6f8261956b4bca150184b466fffe8e3b9: Status 404 returned error can't find the container with id b939ce53a77f1817505cb419da37c7c6f8261956b4bca150184b466fffe8e3b9 Nov 03 17:40:56.259096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:56.259048 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" event={"ID":"2f29a52b-7a08-4087-bce5-98ac64c3cff6","Type":"ContainerStarted","Data":"b939ce53a77f1817505cb419da37c7c6f8261956b4bca150184b466fffe8e3b9"} Nov 03 17:40:57.266174 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.266132 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" event={"ID":"2f29a52b-7a08-4087-bce5-98ac64c3cff6","Type":"ContainerStarted","Data":"ace4fb17b51fd947bda2b892cc4567142eb2229530dc67a06d7c7fd65b87c227"} Nov 03 17:40:57.289659 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.289526 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" podStartSLOduration=1.901274995 podStartE2EDuration="3.289510262s" totalImagesPullingTime="1.388235267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:57.288739672 +0000 UTC m=+689.125852496" watchObservedRunningTime="2026-11-03 17:40:57.289510262 +0000 UTC m=+689.126623087" Nov 03 17:40:57.303462 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.303426 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9"] Nov 03 17:40:57.307285 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.307249 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.317873 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.317831 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Nov 03 17:40:57.321635 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.321603 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9"] Nov 03 17:40:57.417950 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.417910 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.418162 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.418136 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.418231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.418201 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.418291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.418267 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.418331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.418302 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwp8\" (UniqueName: \"kubernetes.io/projected/f35f854e-486f-4df4-bd48-047b4f6d0a07-kube-api-access-mcwp8\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.418331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.418324 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f35f854e-486f-4df4-bd48-047b4f6d0a07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519179 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519237 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519547 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519386 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519547 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519436 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwp8\" (UniqueName: \"kubernetes.io/projected/f35f854e-486f-4df4-bd48-047b4f6d0a07-kube-api-access-mcwp8\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519547 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519470 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f35f854e-486f-4df4-bd48-047b4f6d0a07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519747 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519557 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519747 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519719 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.519747 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.519739 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.520026 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.520002 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.521932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.521902 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f35f854e-486f-4df4-bd48-047b4f6d0a07-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.522301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.522276 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f35f854e-486f-4df4-bd48-047b4f6d0a07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.532411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.532388 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwp8\" (UniqueName: \"kubernetes.io/projected/f35f854e-486f-4df4-bd48-047b4f6d0a07-kube-api-access-mcwp8\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfcc9\" (UID: \"f35f854e-486f-4df4-bd48-047b4f6d0a07\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.622640 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.622599 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:40:57.905768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:57.905738 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9"] Nov 03 17:40:57.907774 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:40:57.907745 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35f854e_486f_4df4_bd48_047b4f6d0a07.slice/crio-acc4a1a5506eed64e7010669eb1328f520df4402801cc7cd6a43e1ffc559a7ff WatchSource:0}: Error finding container acc4a1a5506eed64e7010669eb1328f520df4402801cc7cd6a43e1ffc559a7ff: Status 404 returned error can't find the container with id acc4a1a5506eed64e7010669eb1328f520df4402801cc7cd6a43e1ffc559a7ff Nov 03 17:40:58.249382 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:58.249354 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:40:58.272263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:58.272231 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" event={"ID":"f35f854e-486f-4df4-bd48-047b4f6d0a07","Type":"ContainerStarted","Data":"acc4a1a5506eed64e7010669eb1328f520df4402801cc7cd6a43e1ffc559a7ff"} Nov 03 17:40:59.278460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:59.278423 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" event={"ID":"f35f854e-486f-4df4-bd48-047b4f6d0a07","Type":"ContainerStarted","Data":"00088e67e1532cfcb53098412e53ae650c23a1480d0a77c0e1695b726d32c897"} Nov 03 17:40:59.300706 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:59.300631 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" podStartSLOduration=1.9951759610000002 podStartE2EDuration="2.300617213s" totalImagesPullingTime="305.441252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:59.298935216 +0000 UTC m=+691.136048040" watchObservedRunningTime="2026-11-03 17:40:59.300617213 +0000 UTC m=+691.137730035" Nov 03 17:40:59.623667 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:40:59.623542 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:41:01.953357 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:01.953323 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx"] Nov 03 17:41:01.956901 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:01.956882 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:01.968046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:01.968019 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Nov 03 17:41:01.970147 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:01.970122 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx"] Nov 03 17:41:02.061100 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061065 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpsrn\" (UniqueName: \"kubernetes.io/projected/e9d8b694-81fe-49b5-aaec-0308d3d6722d-kube-api-access-bpsrn\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.061100 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061105 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.061313 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061139 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.061313 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061224 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.061383 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061316 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.061383 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.061349 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162048 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162009 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162057 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162107 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpsrn\" (UniqueName: \"kubernetes.io/projected/e9d8b694-81fe-49b5-aaec-0308d3d6722d-kube-api-access-bpsrn\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162130 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162180 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162197 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162627 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162605 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162701 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162651 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.162701 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.162663 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.164304 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.164273 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d8b694-81fe-49b5-aaec-0308d3d6722d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.164822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.164806 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d8b694-81fe-49b5-aaec-0308d3d6722d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.174974 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.174946 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpsrn\" (UniqueName: \"kubernetes.io/projected/e9d8b694-81fe-49b5-aaec-0308d3d6722d-kube-api-access-bpsrn\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx\" (UID: \"e9d8b694-81fe-49b5-aaec-0308d3d6722d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.271475 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.271389 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:02.546015 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:02.545958 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx"] Nov 03 17:41:02.548200 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:02.548174 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d8b694_81fe_49b5_aaec_0308d3d6722d.slice/crio-5071b0811490ccd764010dfd6030c3bb161a0e04a021766bb686888c04b98129 WatchSource:0}: Error finding container 5071b0811490ccd764010dfd6030c3bb161a0e04a021766bb686888c04b98129: Status 404 returned error can't find the container with id 5071b0811490ccd764010dfd6030c3bb161a0e04a021766bb686888c04b98129 Nov 03 17:41:03.268429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.268392 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw"] Nov 03 17:41:03.272595 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.272516 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.282909 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.282877 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw"] Nov 03 17:41:03.283057 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.282989 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Nov 03 17:41:03.299446 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.299413 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" event={"ID":"e9d8b694-81fe-49b5-aaec-0308d3d6722d","Type":"ContainerStarted","Data":"d29108f08eb5f04c29faabda6db5f2aecafc7b081b694ff5bf9e72fa4e527284"} Nov 03 17:41:03.299623 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.299474 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" event={"ID":"e9d8b694-81fe-49b5-aaec-0308d3d6722d","Type":"ContainerStarted","Data":"5071b0811490ccd764010dfd6030c3bb161a0e04a021766bb686888c04b98129"} Nov 03 17:41:03.328919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.328852 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" podStartSLOduration=2.013826115 podStartE2EDuration="2.328831316s" totalImagesPullingTime="315.005201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:03.325111157 +0000 UTC m=+695.162223982" watchObservedRunningTime="2026-11-03 17:41:03.328831316 +0000 UTC m=+695.165944141" Nov 03 17:41:03.373680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.373635 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.373883 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.373752 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.373883 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.373853 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.374000 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.373974 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9ffr\" (UniqueName: \"kubernetes.io/projected/5890de18-58f7-4769-849f-3bc1b1e99a78-kube-api-access-k9ffr\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.374128 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.374107 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.374210 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.374149 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5890de18-58f7-4769-849f-3bc1b1e99a78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.474869 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.474825 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9ffr\" (UniqueName: \"kubernetes.io/projected/5890de18-58f7-4769-849f-3bc1b1e99a78-kube-api-access-k9ffr\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475064 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.474897 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475064 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.474926 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5890de18-58f7-4769-849f-3bc1b1e99a78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475064 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.474964 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475064 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.475009 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475064 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.475054 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.475378 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.475447 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.475688 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.475671 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.477405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.477372 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5890de18-58f7-4769-849f-3bc1b1e99a78-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.477819 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.477797 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5890de18-58f7-4769-849f-3bc1b1e99a78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.488203 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.488170 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9ffr\" (UniqueName: \"kubernetes.io/projected/5890de18-58f7-4769-849f-3bc1b1e99a78-kube-api-access-k9ffr\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw\" (UID: \"5890de18-58f7-4769-849f-3bc1b1e99a78\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.588455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.588351 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:03.872062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:03.872032 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw"] Nov 03 17:41:03.873860 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:03.873834 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5890de18_58f7_4769_849f_3bc1b1e99a78.slice/crio-882ba4a9083332bc8e4107cee3058ae484063b87821fd679938127ebb040be4f WatchSource:0}: Error finding container 882ba4a9083332bc8e4107cee3058ae484063b87821fd679938127ebb040be4f: Status 404 returned error can't find the container with id 882ba4a9083332bc8e4107cee3058ae484063b87821fd679938127ebb040be4f Nov 03 17:41:04.272432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:04.272396 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:04.306524 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:04.306486 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" event={"ID":"5890de18-58f7-4769-849f-3bc1b1e99a78","Type":"ContainerStarted","Data":"e4b4f6149ffb361d8056a2e2893b413615a451e749b2ee1ac7f1b80c8817a261"} Nov 03 17:41:04.306685 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:04.306537 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" event={"ID":"5890de18-58f7-4769-849f-3bc1b1e99a78","Type":"ContainerStarted","Data":"882ba4a9083332bc8e4107cee3058ae484063b87821fd679938127ebb040be4f"} Nov 03 17:41:04.326312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:04.326248 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" podStartSLOduration=0.996773371 podStartE2EDuration="1.326231049s" totalImagesPullingTime="329.457678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:04.325648953 +0000 UTC m=+696.162761778" watchObservedRunningTime="2026-11-03 17:41:04.326231049 +0000 UTC m=+696.163343872" Nov 03 17:41:04.589060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:04.588975 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:05.249871 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:05.249831 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:41:05.262227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:05.262200 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:41:05.323836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:05.323810 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hqsx9" Nov 03 17:41:07.623185 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:07.623145 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:41:07.635784 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:07.635753 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:41:08.340847 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:08.340817 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfcc9" Nov 03 17:41:12.271543 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:12.271504 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:12.284215 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:12.284181 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:12.357971 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:12.357938 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx" Nov 03 17:41:13.589160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:13.589119 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:13.601855 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:13.601822 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:14.368242 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:14.368211 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw" Nov 03 17:41:17.529412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.529374 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d976d64f5-zh78d"] Nov 03 17:41:17.532983 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.532960 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.542220 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.542191 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d976d64f5-zh78d"] Nov 03 17:41:17.703941 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.703907 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-tls-cert\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.704141 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.703978 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx98b\" (UniqueName: \"kubernetes.io/projected/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-kube-api-access-dx98b\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.704141 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.704068 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-oidc-ca\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.804729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.804636 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx98b\" (UniqueName: \"kubernetes.io/projected/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-kube-api-access-dx98b\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.804729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.804676 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-oidc-ca\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.804729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.804724 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-tls-cert\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.805355 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.805334 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-oidc-ca\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.807115 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.807096 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-tls-cert\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.817917 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.817889 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx98b\" (UniqueName: \"kubernetes.io/projected/ffad44c3-2b73-4842-8c6f-7c80948bbf1d-kube-api-access-dx98b\") pod \"authorino-d976d64f5-zh78d\" (UID: \"ffad44c3-2b73-4842-8c6f-7c80948bbf1d\") " pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:17.846995 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:17.846970 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d976d64f5-zh78d" Nov 03 17:41:18.120087 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:18.120062 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d976d64f5-zh78d"] Nov 03 17:41:18.122340 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:18.122314 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffad44c3_2b73_4842_8c6f_7c80948bbf1d.slice/crio-bc1257135c822efa5eb66e0f442f709ae1e60a4950cdf6537f945684adcd12ff WatchSource:0}: Error finding container bc1257135c822efa5eb66e0f442f709ae1e60a4950cdf6537f945684adcd12ff: Status 404 returned error can't find the container with id bc1257135c822efa5eb66e0f442f709ae1e60a4950cdf6537f945684adcd12ff Nov 03 17:41:18.384792 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:18.384711 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d976d64f5-zh78d" event={"ID":"ffad44c3-2b73-4842-8c6f-7c80948bbf1d","Type":"ContainerStarted","Data":"bc1257135c822efa5eb66e0f442f709ae1e60a4950cdf6537f945684adcd12ff"} Nov 03 17:41:19.415104 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:41:19.415065 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:41:22.785392 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.785353 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:41:22.790118 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.790099 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.794371 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.794348 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 17:41:22.794984 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.794961 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k65cg\"" Nov 03 17:41:22.806475 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.806449 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:41:22.953463 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953426 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953480 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953561 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pks57\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953640 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953807 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953723 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953807 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953753 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953807 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953798 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953945 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953828 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:22.953996 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:22.953931 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054628 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054676 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054698 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054695 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pks57\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054728 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054755 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054776 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054866 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.054954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054927 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055197 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.054961 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055197 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.055114 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055197 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.055146 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055340 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.055273 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055640 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.055616 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.055708 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.055622 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.057077 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.057046 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.057364 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.057346 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.068188 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.068164 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.068293 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.068278 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pks57\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\") pod \"maas-default-gateway-openshift-default-75d7c785f-58ghk\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.105732 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.105703 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:23.385808 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.385782 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:41:23.387593 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:23.387550 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597a28f9_4ac9_46a7_a4c5_2e1fd2ce54c0.slice/crio-802bbe707b1c7cf6a603db048ea750bfc71205939dc09d7e06597bfe730f9379 WatchSource:0}: Error finding container 802bbe707b1c7cf6a603db048ea750bfc71205939dc09d7e06597bfe730f9379: Status 404 returned error can't find the container with id 802bbe707b1c7cf6a603db048ea750bfc71205939dc09d7e06597bfe730f9379 Nov 03 17:41:23.408737 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:23.408703 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" event={"ID":"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0","Type":"ContainerStarted","Data":"802bbe707b1c7cf6a603db048ea750bfc71205939dc09d7e06597bfe730f9379"} Nov 03 17:41:26.089421 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:26.089382 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:26.089786 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:26.089459 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:26.089786 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:26.089489 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:26.426932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:26.426889 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" event={"ID":"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0","Type":"ContainerStarted","Data":"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf"} Nov 03 17:41:26.457777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:26.457690 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podStartSLOduration=1.7586615970000001 podStartE2EDuration="4.457674376s" totalImagesPullingTime="2.699012779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:26.457063834 +0000 UTC m=+718.294176664" watchObservedRunningTime="2026-11-03 17:41:26.457674376 +0000 UTC m=+718.294787200" Nov 03 17:41:27.106226 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:27.106182 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:27.107765 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:27.107735 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:27.107895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:27.107801 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:28.106469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:28.106438 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:28.106841 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:28.106497 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:29.106911 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.106874 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:29.107278 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.106931 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:29.458901 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.458865 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d976d64f5-zh78d" event={"ID":"ffad44c3-2b73-4842-8c6f-7c80948bbf1d","Type":"ContainerStarted","Data":"73b6793c55dbe2f1667a334b5187fb39685f497a41d7e44a6173e4b16c1d3c78"} Nov 03 17:41:29.477317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.477232 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d976d64f5-zh78d" podStartSLOduration=1.607753475 podStartE2EDuration="12.477214935s" totalImagesPullingTime="10.86946146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:29.476543711 +0000 UTC m=+721.313656536" watchObservedRunningTime="2026-11-03 17:41:29.477214935 +0000 UTC m=+721.314327760" Nov 03 17:41:29.506787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.506414 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:41:29.507238 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.507195 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" podUID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" containerName="authorino" containerID="cri-o://6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b" gracePeriod=30 Nov 03 17:41:29.846018 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.845725 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:41:29.944611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.942894 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\") pod \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " Nov 03 17:41:29.944611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.942996 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\" (UniqueName: \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\") pod \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " Nov 03 17:41:29.944611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.943066 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\" (UniqueName: \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\") pod \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\" (UID: \"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb\") " Nov 03 17:41:29.948744 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.948703 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m" pod "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" (UID: "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb"). InnerVolumeSpecName "kube-api-access-zdf4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:41:29.951003 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.950971 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca" pod "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" (UID: "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:41:29.957307 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:29.957274 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert" pod "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" (UID: "a8b30425-64d7-4792-99f7-fd4a4ebf5ebb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:41:30.045062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.045022 4557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-tls-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:41:30.045062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.045056 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdf4m\" (UniqueName: \"kubernetes.io/projected/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-kube-api-access-zdf4m\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:41:30.045062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.045065 4557 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb-oidc-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:41:30.106122 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.106076 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:30.106319 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.106133 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:30.466864 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.466821 4557 generic.go:356] "Generic (PLEG): container finished" podID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" containerID="6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b" exitCode=0 Nov 03 17:41:30.467540 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.467500 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" event={"ID":"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb","Type":"ContainerDied","Data":"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b"} Nov 03 17:41:30.467710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.467543 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" Nov 03 17:41:30.467710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.467557 4557 scope.go:122] "RemoveContainer" containerID="6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b" Nov 03 17:41:30.467710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.467544 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c5b6ccdd-zfmwx" event={"ID":"a8b30425-64d7-4792-99f7-fd4a4ebf5ebb","Type":"ContainerDied","Data":"2609a42502e5aed0e6ee4bc5247c1897c84a68e5ef9de12d176fbdb27de234ea"} Nov 03 17:41:30.478212 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.478182 4557 scope.go:122] "RemoveContainer" containerID="6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b" Nov 03 17:41:30.478469 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:41:30.478447 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b\": container with ID starting with 6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b not found: ID does not exist" containerID="6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b" Nov 03 17:41:30.478508 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.478481 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b"} err="failed to get container status \"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b\": rpc error: code = NotFound desc = could not find container \"6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b\": container with ID starting with 6ca5f458b2d3344a41153f7eec1850258335c948e37dd0a3d3fb278b637e546b not found: ID does not exist" Nov 03 17:41:30.494901 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.494874 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:41:30.497537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:30.497515 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67c5b6ccdd-zfmwx"] Nov 03 17:41:31.106369 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:31.106332 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:31.106561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:31.106393 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:32.106970 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:32.106923 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:32.107496 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:32.106994 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:32.324086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:32.324046 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" path="/var/lib/kubelet/pods/a8b30425-64d7-4792-99f7-fd4a4ebf5ebb/volumes" Nov 03 17:41:33.107100 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:33.107067 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Nov 03 17:41:33.107472 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:33.107127 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Nov 03 17:41:34.671840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:34.671810 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:34.672324 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:34.672236 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:34.673231 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:34.673207 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:41:37.811422 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.811381 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:41:37.811817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.811776 4557 cpu_manager.go:414] "containerMap: removing container" podUID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" containerName="authorino" Nov 03 17:41:37.811817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.811788 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" containerName="authorino" Nov 03 17:41:37.811887 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.811874 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8b30425-64d7-4792-99f7-fd4a4ebf5ebb" containerName="authorino" Nov 03 17:41:37.816448 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.816428 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.822841 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.822890 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.822922 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823013 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823094 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823149 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823246 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823279 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.823504 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.823304 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g7jd\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.830456 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.830428 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:41:37.846797 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.846760 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:41:37.850492 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.850468 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.870490 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.870414 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:41:37.923760 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923724 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.923933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923767 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.923933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923793 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b76np\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.923933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923894 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923931 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923953 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.923977 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924057 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924092 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g7jd\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924143 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924156 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924193 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924333 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924272 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924333 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924316 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924344 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924370 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:37.924469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924401 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924607 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924585 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924683 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924626 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924735 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924706 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924858 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924803 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.924858 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924833 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.925061 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.924981 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.926658 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.926638 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.926783 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.926760 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.936729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.936703 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g7jd\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:37.937166 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:37.937148 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-pdhst\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:38.025084 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025048 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025084 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025090 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025295 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025117 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025467 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025448 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025510 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025483 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025510 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025489 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025622 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025517 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025622 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025610 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025637 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b76np\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025668 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025706 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.025790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.025733 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.026083 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.026063 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.026184 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.026147 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.027881 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.027859 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.028044 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.028026 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.039645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.039622 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b76np\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.039740 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.039653 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-wh8tk\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.129852 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.129757 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:38.166162 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.166127 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:38.419060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.419029 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:41:38.420059 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:38.420036 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d032dd2_9c34_409a_b5fc_37adbd874d69.slice/crio-ad59d383269609d658df93dd0c5d01b054aa167cdd011e81e5aa45173c1a292d WatchSource:0}: Error finding container ad59d383269609d658df93dd0c5d01b054aa167cdd011e81e5aa45173c1a292d: Status 404 returned error can't find the container with id ad59d383269609d658df93dd0c5d01b054aa167cdd011e81e5aa45173c1a292d Nov 03 17:41:38.422341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.422304 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.422411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.422392 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.422454 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.422437 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.465172 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.465150 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:41:38.475756 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:41:38.475726 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a67715_6f72_4333_81ca_266f20a420c8.slice/crio-132fe1201fd939e93da05e20f6f1f2a8f63fd7aa6f83f51f51b9a3c787be2000 WatchSource:0}: Error finding container 132fe1201fd939e93da05e20f6f1f2a8f63fd7aa6f83f51f51b9a3c787be2000: Status 404 returned error can't find the container with id 132fe1201fd939e93da05e20f6f1f2a8f63fd7aa6f83f51f51b9a3c787be2000 Nov 03 17:41:38.477971 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.477941 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.478082 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.478018 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.478082 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.478062 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:41:38.528479 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.528443 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" event={"ID":"1d032dd2-9c34-409a-b5fc-37adbd874d69","Type":"ContainerStarted","Data":"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc"} Nov 03 17:41:38.528653 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.528506 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" event={"ID":"1d032dd2-9c34-409a-b5fc-37adbd874d69","Type":"ContainerStarted","Data":"ad59d383269609d658df93dd0c5d01b054aa167cdd011e81e5aa45173c1a292d"} Nov 03 17:41:38.531237 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.531210 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" event={"ID":"20a67715-6f72-4333-81ca-266f20a420c8","Type":"ContainerStarted","Data":"132fe1201fd939e93da05e20f6f1f2a8f63fd7aa6f83f51f51b9a3c787be2000"} Nov 03 17:41:38.556127 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:38.556065 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podStartSLOduration=1.55604365 podStartE2EDuration="1.55604365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:38.552277926 +0000 UTC m=+730.389390751" watchObservedRunningTime="2026-11-03 17:41:38.55604365 +0000 UTC m=+730.393156474" Nov 03 17:41:39.132671 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:39.132117 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:39.132671 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:39.132309 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:39.132671 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:39.132360 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:39.573470 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:39.573200 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" event={"ID":"20a67715-6f72-4333-81ca-266f20a420c8","Type":"ContainerStarted","Data":"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f"} Nov 03 17:41:39.599912 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:39.599858 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podStartSLOduration=2.599843282 podStartE2EDuration="2.599843282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:39.597502724 +0000 UTC m=+731.434615548" watchObservedRunningTime="2026-11-03 17:41:39.599843282 +0000 UTC m=+731.436956106" Nov 03 17:41:40.138591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:40.131016 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:40.138591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:40.131083 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:40.169593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:40.169449 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:40.171114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:40.171087 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:40.171290 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:40.171272 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:41.133600 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:41.130961 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:41.133600 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:41.131026 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:41.173604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:41.170684 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:41.173604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:41.170753 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:42.134779 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:42.134722 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:42.135114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:42.135063 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:42.168599 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:42.168049 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:42.168599 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:42.168153 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:43.132060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:43.132020 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:43.132683 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:43.132652 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:43.167736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:43.167700 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:43.168009 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:43.167984 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:44.133472 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:44.133016 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:44.133472 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:44.133081 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:44.171062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:44.171020 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:44.173734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:44.173657 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:45.130254 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:45.130213 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Nov 03 17:41:45.130405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:45.130286 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Nov 03 17:41:45.167008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:45.166968 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Nov 03 17:41:45.167395 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:45.167025 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Nov 03 17:41:46.890184 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.890147 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:46.890807 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.890778 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:46.891752 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.891718 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:41:46.959422 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.959389 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:46.959850 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.959831 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:46.960843 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:41:46.960818 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:41:49.414536 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:41:49.414496 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:42:06.000751 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.000711 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:42:06.011358 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.011325 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.014632 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.014600 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:42:06.016813 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.016790 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-c8e6be7b-unmatched-kserve-self-signed-certs\"" Nov 03 17:42:06.145158 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.145093 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.159863 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.159827 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb55j\" (UniqueName: \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.164346 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.164311 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.186592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.185738 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.186592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.185836 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.186592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.185884 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.287218 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.287113 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.287466 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.287444 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.287665 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.287647 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.287808 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.287790 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.287985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.287968 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.288129 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.288110 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb55j\" (UniqueName: \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.289008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.288985 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.289413 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.289393 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.289846 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.289826 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.293649 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.293603 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.294501 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.294251 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.303451 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.303428 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb55j\" (UniqueName: \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\") pod \"grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.365848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.365803 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:06.732591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:06.728325 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:42:06.796237 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:42:06.796195 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53855875_0c7f_4e12_8dce_cd6f4bbdd3aa.slice/crio-6f879172fc92340d6a87fb5d17ed7efb0013a742f58a79d43ecf2ea91ad262cb WatchSource:0}: Error finding container 6f879172fc92340d6a87fb5d17ed7efb0013a742f58a79d43ecf2ea91ad262cb: Status 404 returned error can't find the container with id 6f879172fc92340d6a87fb5d17ed7efb0013a742f58a79d43ecf2ea91ad262cb Nov 03 17:42:07.796773 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:07.796736 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" event={"ID":"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa","Type":"ContainerStarted","Data":"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0"} Nov 03 17:42:07.796773 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:07.796779 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" event={"ID":"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa","Type":"ContainerStarted","Data":"6f879172fc92340d6a87fb5d17ed7efb0013a742f58a79d43ecf2ea91ad262cb"} Nov 03 17:42:07.818329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:07.818276 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" podStartSLOduration=2.8182631799999998 podStartE2EDuration="2.81826318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:42:07.81594782 +0000 UTC m=+759.653060641" watchObservedRunningTime="2026-11-03 17:42:07.81826318 +0000 UTC m=+759.655376003" Nov 03 17:42:08.367092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:08.367048 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:16.367078 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:16.366995 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:16.379636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:16.379609 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:16.853541 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:16.853511 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:42:19.414530 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:42:19.414495 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:42:22.921958 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:22.921924 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:42:22.925351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:22.925330 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:22.938487 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:22.938459 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:42:23.002225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002185 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002232 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002449 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002313 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002449 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002339 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002449 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002372 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002462 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002521 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002554 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.002680 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.002615 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7jh\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.103888 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.103856 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.103903 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.103922 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.103966 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104014 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104041 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104066 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104380 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104092 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7jh\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104380 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104166 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104492 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104421 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104553 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104506 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104642 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104561 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104701 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104689 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.104758 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.104734 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.106101 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.106082 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.106495 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.106471 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.116716 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.116694 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.116827 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.116760 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7jh\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\") pod \"maas-default-gateway-openshift-default-75d7c785f-j5vsb\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.243192 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.243098 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:23.524387 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.524354 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:42:23.525844 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:42:23.525815 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37479f66_ad1c_4520_bbd2_551ad87df1a1.slice/crio-a327c6bd46bc33253eacdfaecaf1708ba62dd6a193f4774ebafbfdf00682468d WatchSource:0}: Error finding container a327c6bd46bc33253eacdfaecaf1708ba62dd6a193f4774ebafbfdf00682468d: Status 404 returned error can't find the container with id a327c6bd46bc33253eacdfaecaf1708ba62dd6a193f4774ebafbfdf00682468d Nov 03 17:42:23.528030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.528001 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:42:23.528113 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.528088 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:42:23.528154 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.528117 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:42:23.884745 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.884642 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" event={"ID":"37479f66-ad1c-4520-bbd2-551ad87df1a1","Type":"ContainerStarted","Data":"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564"} Nov 03 17:42:23.884745 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.884705 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" event={"ID":"37479f66-ad1c-4520-bbd2-551ad87df1a1","Type":"ContainerStarted","Data":"a327c6bd46bc33253eacdfaecaf1708ba62dd6a193f4774ebafbfdf00682468d"} Nov 03 17:42:23.910793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:23.910738 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podStartSLOduration=1.910722731 podStartE2EDuration="1.910722731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:42:23.90928056 +0000 UTC m=+775.746393385" watchObservedRunningTime="2026-11-03 17:42:23.910722731 +0000 UTC m=+775.747835555" Nov 03 17:42:24.243759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:24.243717 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:24.245675 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:24.245646 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:24.245782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:24.245720 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:25.244051 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:25.244010 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:25.244513 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:25.244082 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:26.243978 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:26.243940 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:26.244190 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:26.244007 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:27.244028 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:27.243988 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:27.244205 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:27.244044 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:28.244025 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:28.243982 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:28.244247 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:28.244042 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:29.244014 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:29.243975 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:29.244224 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:29.244038 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:30.244258 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:30.244225 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:30.244669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:30.244295 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:31.244085 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:31.244038 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Nov 03 17:42:31.244271 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:31.244116 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Nov 03 17:42:32.449598 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:32.447605 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:32.449598 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:32.448533 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:32.449598 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:42:32.449480 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:42:49.414836 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:42:49.414801 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:43:19.415689 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:43:19.415644 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:43:49.414556 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:43:49.414518 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:44:19.224108 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.224069 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z"] Nov 03 17:44:19.227435 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.227415 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.238146 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.238125 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:44:19.238409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.238389 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:44:19.238487 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.238463 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:44:19.238521 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.238486 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:44:19.246632 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.246611 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.246703 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.246664 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrznj\" (UniqueName: \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.246787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.246771 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.272376 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.272344 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z"] Nov 03 17:44:19.347240 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.347200 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrznj\" (UniqueName: \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.347442 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.347287 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.347442 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.347352 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.348137 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.348114 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.349895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.349869 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.360394 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.360368 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrznj\" (UniqueName: \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\") pod \"maas-api-revoke-sub-57f5f62d-rg72z\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.414587 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:44:19.414529 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:44:19.540713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.540634 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:19.818692 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:19.818668 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z"] Nov 03 17:44:19.821192 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:44:19.821168 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc8d139_ad50_46be_a7d0_56cf9c797977.slice/crio-57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6 WatchSource:0}: Error finding container 57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6: Status 404 returned error can't find the container with id 57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6 Nov 03 17:44:20.475799 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:20.475764 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" event={"ID":"ecc8d139-ad50-46be-a7d0-56cf9c797977","Type":"ContainerStarted","Data":"57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6"} Nov 03 17:44:23.493693 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:23.493650 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" event={"ID":"ecc8d139-ad50-46be-a7d0-56cf9c797977","Type":"ContainerStarted","Data":"689a7128dbe619b12804380480f84208dcbae808907460e15b9a8c0b937ca012"} Nov 03 17:44:23.523195 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:23.523139 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" podStartSLOduration=1.5341261849999999 podStartE2EDuration="4.523124967s" totalImagesPullingTime="2.988998782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:44:23.520741074 +0000 UTC m=+895.357853898" watchObservedRunningTime="2026-11-03 17:44:23.523124967 +0000 UTC m=+895.360237791" Nov 03 17:44:24.500307 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:24.500275 4557 generic.go:356] "Generic (PLEG): container finished" podID="ecc8d139-ad50-46be-a7d0-56cf9c797977" containerID="689a7128dbe619b12804380480f84208dcbae808907460e15b9a8c0b937ca012" exitCode=0 Nov 03 17:44:24.500718 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:24.500364 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" event={"ID":"ecc8d139-ad50-46be-a7d0-56cf9c797977","Type":"ContainerDied","Data":"689a7128dbe619b12804380480f84208dcbae808907460e15b9a8c0b937ca012"} Nov 03 17:44:25.641200 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.641174 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:25.710626 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.710592 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\") pod \"ecc8d139-ad50-46be-a7d0-56cf9c797977\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " Nov 03 17:44:25.710626 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.710629 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\" (UniqueName: \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\") pod \"ecc8d139-ad50-46be-a7d0-56cf9c797977\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " Nov 03 17:44:25.710867 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.710653 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\") pod \"ecc8d139-ad50-46be-a7d0-56cf9c797977\" (UID: \"ecc8d139-ad50-46be-a7d0-56cf9c797977\") " Nov 03 17:44:25.711085 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.711057 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca" pod "ecc8d139-ad50-46be-a7d0-56cf9c797977" (UID: "ecc8d139-ad50-46be-a7d0-56cf9c797977"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:44:25.712968 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.712945 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca" pod "ecc8d139-ad50-46be-a7d0-56cf9c797977" (UID: "ecc8d139-ad50-46be-a7d0-56cf9c797977"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:44:25.713054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.712968 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj" pod "ecc8d139-ad50-46be-a7d0-56cf9c797977" (UID: "ecc8d139-ad50-46be-a7d0-56cf9c797977"). InnerVolumeSpecName "kube-api-access-zrznj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:44:25.812342 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.812261 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:25.812342 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.812290 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrznj\" (UniqueName: \"kubernetes.io/projected/ecc8d139-ad50-46be-a7d0-56cf9c797977-kube-api-access-zrznj\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:25.812342 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:25.812301 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ecc8d139-ad50-46be-a7d0-56cf9c797977-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:26.512250 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:26.512217 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" event={"ID":"ecc8d139-ad50-46be-a7d0-56cf9c797977","Type":"ContainerDied","Data":"57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6"} Nov 03 17:44:26.512419 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:26.512264 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57ba89abd052a982e6bea1a39fb65425fc976a380b489debe61c9327bb73fab6" Nov 03 17:44:26.512419 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:26.512233 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z" Nov 03 17:44:28.432096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:28.432062 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:44:28.434154 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:28.434133 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:44:29.568428 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.568347 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh"] Nov 03 17:44:29.568840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.568787 4557 cpu_manager.go:414] "containerMap: removing container" podUID="ecc8d139-ad50-46be-a7d0-56cf9c797977" containerName="revoke-keys" Nov 03 17:44:29.568840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.568804 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecc8d139-ad50-46be-a7d0-56cf9c797977" containerName="revoke-keys" Nov 03 17:44:29.568931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.568916 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecc8d139-ad50-46be-a7d0-56cf9c797977" containerName="revoke-keys" Nov 03 17:44:29.572298 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.572280 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.580250 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.580222 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:44:29.582408 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.582383 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:44:29.582630 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.582509 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:44:29.583442 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.583406 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh"] Nov 03 17:44:29.583529 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.583415 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:44:29.651829 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.651793 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdlts\" (UniqueName: \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.652016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.651921 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.652016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.651996 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.753481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.753441 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.753674 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.753605 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlts\" (UniqueName: \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.753722 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.753674 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.754232 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.754210 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.755830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.755810 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.767084 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.767061 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdlts\" (UniqueName: \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\") pod \"maas-api-revoke-sub-d802791d-9v9dh\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:29.886704 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:29.886622 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:30.161486 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:30.161458 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh"] Nov 03 17:44:30.163390 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:44:30.163360 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4550e8_06c2_44b4_9887_bcfd35c93b1b.slice/crio-8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44 WatchSource:0}: Error finding container 8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44: Status 404 returned error can't find the container with id 8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44 Nov 03 17:44:30.533919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:30.533880 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" event={"ID":"da4550e8-06c2-44b4-9887-bcfd35c93b1b","Type":"ContainerStarted","Data":"abf372c6d2eb59664d6ba88fb6024280ebe807e9b72a6a397d2d62cf29f612e3"} Nov 03 17:44:30.534095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:30.533943 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" event={"ID":"da4550e8-06c2-44b4-9887-bcfd35c93b1b","Type":"ContainerStarted","Data":"8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44"} Nov 03 17:44:30.586232 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:30.586176 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" podStartSLOduration=1.5861594430000001 podStartE2EDuration="1.586159443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:44:30.584433439 +0000 UTC m=+902.421546263" watchObservedRunningTime="2026-11-03 17:44:30.586159443 +0000 UTC m=+902.423272268" Nov 03 17:44:31.540463 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:31.540425 4557 generic.go:356] "Generic (PLEG): container finished" podID="da4550e8-06c2-44b4-9887-bcfd35c93b1b" containerID="abf372c6d2eb59664d6ba88fb6024280ebe807e9b72a6a397d2d62cf29f612e3" exitCode=0 Nov 03 17:44:31.540690 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:31.540517 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" event={"ID":"da4550e8-06c2-44b4-9887-bcfd35c93b1b","Type":"ContainerDied","Data":"abf372c6d2eb59664d6ba88fb6024280ebe807e9b72a6a397d2d62cf29f612e3"} Nov 03 17:44:32.739975 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.739939 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:32.890511 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.890420 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\") pod \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " Nov 03 17:44:32.891159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.891133 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\" (UniqueName: \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\") pod \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " Nov 03 17:44:32.891369 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.891351 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\") pod \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\" (UID: \"da4550e8-06c2-44b4-9887-bcfd35c93b1b\") " Nov 03 17:44:32.892343 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.891063 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca" pod "da4550e8-06c2-44b4-9887-bcfd35c93b1b" (UID: "da4550e8-06c2-44b4-9887-bcfd35c93b1b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:44:32.921801 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.916740 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts" pod "da4550e8-06c2-44b4-9887-bcfd35c93b1b" (UID: "da4550e8-06c2-44b4-9887-bcfd35c93b1b"). InnerVolumeSpecName "kube-api-access-bdlts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:44:32.933768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.933702 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca" pod "da4550e8-06c2-44b4-9887-bcfd35c93b1b" (UID: "da4550e8-06c2-44b4-9887-bcfd35c93b1b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:44:32.994302 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.994190 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:32.994302 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.994252 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdlts\" (UniqueName: \"kubernetes.io/projected/da4550e8-06c2-44b4-9887-bcfd35c93b1b-kube-api-access-bdlts\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:32.994302 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:32.994271 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/da4550e8-06c2-44b4-9887-bcfd35c93b1b-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:33.594270 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:33.594212 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" event={"ID":"da4550e8-06c2-44b4-9887-bcfd35c93b1b","Type":"ContainerDied","Data":"8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44"} Nov 03 17:44:33.595585 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:33.594550 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d186a78d89b1081315347886a8521533846eabc67834a25d3a76ac825175c44" Nov 03 17:44:33.595764 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:33.595548 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh" Nov 03 17:44:39.796928 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.796895 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9"] Nov 03 17:44:39.797309 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.797272 4557 cpu_manager.go:414] "containerMap: removing container" podUID="da4550e8-06c2-44b4-9887-bcfd35c93b1b" containerName="revoke-keys" Nov 03 17:44:39.797309 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.797282 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da4550e8-06c2-44b4-9887-bcfd35c93b1b" containerName="revoke-keys" Nov 03 17:44:39.797380 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.797367 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="da4550e8-06c2-44b4-9887-bcfd35c93b1b" containerName="revoke-keys" Nov 03 17:44:39.800706 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.800686 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:39.806135 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.806099 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:44:39.807505 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.807478 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:44:39.807780 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.807507 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:44:39.808743 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.807650 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:44:39.810732 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.810710 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9"] Nov 03 17:44:39.964964 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.964924 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:39.965145 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.965007 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxql\" (UniqueName: \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:39.965198 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:39.965146 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.066218 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.066125 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.066218 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.066175 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.066454 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.066224 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxql\" (UniqueName: \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.066887 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.066861 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.068612 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.068586 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.079586 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.079546 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxql\" (UniqueName: \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\") pod \"maas-api-revoke-sub-e27c27a8-b52f9\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.118226 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.118188 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:40.393245 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.393219 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9"] Nov 03 17:44:40.395093 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:44:40.395065 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3645d355_e742_411a_bcf4_a4b36860cb0d.slice/crio-7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011 WatchSource:0}: Error finding container 7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011: Status 404 returned error can't find the container with id 7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011 Nov 03 17:44:40.694872 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:40.694839 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" event={"ID":"3645d355-e742-411a-bcf4-a4b36860cb0d","Type":"ContainerStarted","Data":"7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011"} Nov 03 17:44:41.701549 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:41.701510 4557 generic.go:356] "Generic (PLEG): container finished" podID="3645d355-e742-411a-bcf4-a4b36860cb0d" containerID="dac08f123705d3efabe4c81cb9cc71885db4411c484600bcdc610026a1d3fb7f" exitCode=0 Nov 03 17:44:41.702024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:41.701599 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" event={"ID":"3645d355-e742-411a-bcf4-a4b36860cb0d","Type":"ContainerDied","Data":"dac08f123705d3efabe4c81cb9cc71885db4411c484600bcdc610026a1d3fb7f"} Nov 03 17:44:42.836700 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.836671 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:42.996046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.995950 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\") pod \"3645d355-e742-411a-bcf4-a4b36860cb0d\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " Nov 03 17:44:42.996046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.996018 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\" (UniqueName: \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\") pod \"3645d355-e742-411a-bcf4-a4b36860cb0d\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " Nov 03 17:44:42.996282 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.996095 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\") pod \"3645d355-e742-411a-bcf4-a4b36860cb0d\" (UID: \"3645d355-e742-411a-bcf4-a4b36860cb0d\") " Nov 03 17:44:42.996418 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.996389 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca" pod "3645d355-e742-411a-bcf4-a4b36860cb0d" (UID: "3645d355-e742-411a-bcf4-a4b36860cb0d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:44:42.998144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.998115 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca" pod "3645d355-e742-411a-bcf4-a4b36860cb0d" (UID: "3645d355-e742-411a-bcf4-a4b36860cb0d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:44:42.998250 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:42.998142 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql" pod "3645d355-e742-411a-bcf4-a4b36860cb0d" (UID: "3645d355-e742-411a-bcf4-a4b36860cb0d"). InnerVolumeSpecName "kube-api-access-4sxql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:44:43.097652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.097617 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:43.097652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.097644 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sxql\" (UniqueName: \"kubernetes.io/projected/3645d355-e742-411a-bcf4-a4b36860cb0d-kube-api-access-4sxql\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:43.097652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.097653 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3645d355-e742-411a-bcf4-a4b36860cb0d-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:43.714349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.714315 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" Nov 03 17:44:43.714516 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.714306 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9" event={"ID":"3645d355-e742-411a-bcf4-a4b36860cb0d","Type":"ContainerDied","Data":"7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011"} Nov 03 17:44:43.714516 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:43.714445 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cebd31252f68d08c15ea64fd805244e6d93ba0e08e92cfb571d3f4c806c6011" Nov 03 17:44:49.414716 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:44:49.414678 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:44:50.030949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.030906 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7"] Nov 03 17:44:50.031622 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.031598 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3645d355-e742-411a-bcf4-a4b36860cb0d" containerName="revoke-keys" Nov 03 17:44:50.031720 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.031625 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3645d355-e742-411a-bcf4-a4b36860cb0d" containerName="revoke-keys" Nov 03 17:44:50.031781 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.031754 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="3645d355-e742-411a-bcf4-a4b36860cb0d" containerName="revoke-keys" Nov 03 17:44:50.035248 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.035224 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.039811 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.039784 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:44:50.040126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.040100 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:44:50.041183 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.041165 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:44:50.041329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.041281 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:44:50.045709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.044548 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7"] Nov 03 17:44:50.058236 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.058207 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5nv\" (UniqueName: \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.058397 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.058252 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.058397 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.058340 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.159618 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.159555 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.159793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.159648 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5nv\" (UniqueName: \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.159793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.159699 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.160390 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.160364 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.162070 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.162038 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.172945 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.172916 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5nv\" (UniqueName: \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\") pod \"maas-api-revoke-sub-abf6130d-djtc7\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.352998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.352918 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:50.638046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.638017 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7"] Nov 03 17:44:50.639664 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:44:50.639637 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae284b8_f0c9_48ba_bd61_94d2469d30c6.slice/crio-60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757 WatchSource:0}: Error finding container 60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757: Status 404 returned error can't find the container with id 60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757 Nov 03 17:44:50.749005 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:50.748970 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" event={"ID":"1ae284b8-f0c9-48ba-bd61-94d2469d30c6","Type":"ContainerStarted","Data":"60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757"} Nov 03 17:44:51.759480 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:51.759432 4557 generic.go:356] "Generic (PLEG): container finished" podID="1ae284b8-f0c9-48ba-bd61-94d2469d30c6" containerID="365f710a02be6ea30ad38a86088159532964317ac552eab4550e7c1048b5585d" exitCode=0 Nov 03 17:44:51.760095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:51.759527 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" event={"ID":"1ae284b8-f0c9-48ba-bd61-94d2469d30c6","Type":"ContainerDied","Data":"365f710a02be6ea30ad38a86088159532964317ac552eab4550e7c1048b5585d"} Nov 03 17:44:53.502894 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.502856 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:44:53.635252 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.635155 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\") pod \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " Nov 03 17:44:53.635530 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.635506 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\" (UniqueName: \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\") pod \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " Nov 03 17:44:53.635700 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.635681 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\") pod \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\" (UID: \"1ae284b8-f0c9-48ba-bd61-94d2469d30c6\") " Nov 03 17:44:53.639782 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.639753 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca" pod "1ae284b8-f0c9-48ba-bd61-94d2469d30c6" (UID: "1ae284b8-f0c9-48ba-bd61-94d2469d30c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:44:53.669679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.669611 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca" pod "1ae284b8-f0c9-48ba-bd61-94d2469d30c6" (UID: "1ae284b8-f0c9-48ba-bd61-94d2469d30c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:44:53.670351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.670323 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv" pod "1ae284b8-f0c9-48ba-bd61-94d2469d30c6" (UID: "1ae284b8-f0c9-48ba-bd61-94d2469d30c6"). InnerVolumeSpecName "kube-api-access-qr5nv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:44:53.738370 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.738319 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:53.738689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.738650 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr5nv\" (UniqueName: \"kubernetes.io/projected/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-kube-api-access-qr5nv\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:53.738868 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.738849 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ae284b8-f0c9-48ba-bd61-94d2469d30c6-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:44:53.802476 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.802349 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" event={"ID":"1ae284b8-f0c9-48ba-bd61-94d2469d30c6","Type":"ContainerDied","Data":"60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757"} Nov 03 17:44:53.806611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.802767 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60c965e724400dc1820de65769993af2ca6026b4ea30df9bbec1ba97d988b757" Nov 03 17:44:53.806611 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:44:53.802865 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7" Nov 03 17:45:00.143836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.143803 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:00.144227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.144202 4557 cpu_manager.go:414] "containerMap: removing container" podUID="1ae284b8-f0c9-48ba-bd61-94d2469d30c6" containerName="revoke-keys" Nov 03 17:45:00.144227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.144215 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ae284b8-f0c9-48ba-bd61-94d2469d30c6" containerName="revoke-keys" Nov 03 17:45:00.144298 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.144272 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ae284b8-f0c9-48ba-bd61-94d2469d30c6" containerName="revoke-keys" Nov 03 17:45:00.150106 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.150080 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.158270 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.157949 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:45:00.158270 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.158057 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:45:00.158489 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.158463 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:00.163114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.163088 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:45:00.237769 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.237737 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdc2\" (UniqueName: \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.237933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.237782 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.338704 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.338667 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdc2\" (UniqueName: \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.338892 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.338762 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.339378 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.339354 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.351778 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.351748 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdc2\" (UniqueName: \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\") pod \"maas-api-key-cleanup-29895465-chn58\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.469515 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.469486 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:00.752024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.751997 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:00.753480 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:45:00.753452 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5188df56_7ecf_43b0_884d_3ce72cf193ad.slice/crio-4cf8f768f8a0b747b7176c97e25df26d0ac7837f2dc29194bdef51b27e7c5e5e WatchSource:0}: Error finding container 4cf8f768f8a0b747b7176c97e25df26d0ac7837f2dc29194bdef51b27e7c5e5e: Status 404 returned error can't find the container with id 4cf8f768f8a0b747b7176c97e25df26d0ac7837f2dc29194bdef51b27e7c5e5e Nov 03 17:45:00.862672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:00.862635 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerStarted","Data":"4cf8f768f8a0b747b7176c97e25df26d0ac7837f2dc29194bdef51b27e7c5e5e"} Nov 03 17:45:01.874459 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:01.874357 4557 generic.go:356] "Generic (PLEG): container finished" podID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerID="772f6af4b0486b3e4d0b2f566c81f4ab3f2a71d45aa014fafc74f3de86e2f2bb" exitCode=60 Nov 03 17:45:01.874983 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:01.874460 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerDied","Data":"772f6af4b0486b3e4d0b2f566c81f4ab3f2a71d45aa014fafc74f3de86e2f2bb"} Nov 03 17:45:01.874983 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:01.874801 4557 scope.go:122] "RemoveContainer" containerID="772f6af4b0486b3e4d0b2f566c81f4ab3f2a71d45aa014fafc74f3de86e2f2bb" Nov 03 17:45:02.901228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:02.901160 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerStarted","Data":"a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e"} Nov 03 17:45:03.923426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:03.923392 4557 generic.go:356] "Generic (PLEG): container finished" podID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerID="a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e" exitCode=60 Nov 03 17:45:03.924104 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:03.924075 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerDied","Data":"a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e"} Nov 03 17:45:03.924289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:03.924271 4557 scope.go:122] "RemoveContainer" containerID="772f6af4b0486b3e4d0b2f566c81f4ab3f2a71d45aa014fafc74f3de86e2f2bb" Nov 03 17:45:03.924899 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:03.924878 4557 scope.go:122] "RemoveContainer" containerID="a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e" Nov 03 17:45:03.925347 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:03.925320 4557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895465-chn58_odh-ai-gateway-infra(5188df56-7ecf-43b0-884d-3ce72cf193ad)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" Nov 03 17:45:04.949093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:04.949059 4557 scope.go:122] "RemoveContainer" containerID="a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e" Nov 03 17:45:04.949966 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:04.949936 4557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895465-chn58_odh-ai-gateway-infra(5188df56-7ecf-43b0-884d-3ce72cf193ad)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" Nov 03 17:45:14.978825 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:14.978615 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:45:17.317411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:17.317376 4557 scope.go:122] "RemoveContainer" containerID="a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e" Nov 03 17:45:18.208189 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:18.208151 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerStarted","Data":"42d4e914032198e39763f0eeeb94ab5eb30719297559fde337dde3044f564380"} Nov 03 17:45:18.250058 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:18.249989 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" podStartSLOduration=18.249968122 podStartE2EDuration="18.249968122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:02.947864149 +0000 UTC m=+934.784976974" watchObservedRunningTime="2026-11-03 17:45:18.249968122 +0000 UTC m=+950.087080949" Nov 03 17:45:18.537208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:18.537142 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:45:18.538665 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:18.538623 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:45:19.217646 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:19.217597 4557 generic.go:356] "Generic (PLEG): container finished" podID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerID="42d4e914032198e39763f0eeeb94ab5eb30719297559fde337dde3044f564380" exitCode=60 Nov 03 17:45:19.217844 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:19.217663 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerDied","Data":"42d4e914032198e39763f0eeeb94ab5eb30719297559fde337dde3044f564380"} Nov 03 17:45:19.217844 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:19.217723 4557 scope.go:122] "RemoveContainer" containerID="a66c3c352d424adb5930fe4894706e1b84150d482c8bef2fae43ad95f646491e" Nov 03 17:45:19.218107 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:19.218087 4557 scope.go:122] "RemoveContainer" containerID="42d4e914032198e39763f0eeeb94ab5eb30719297559fde337dde3044f564380" Nov 03 17:45:19.218429 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:19.218396 4557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895465-chn58_odh-ai-gateway-infra(5188df56-7ecf-43b0-884d-3ce72cf193ad)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" Nov 03 17:45:19.254484 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:19.254452 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:19.421809 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:19.421770 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:45:20.435075 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.435033 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:20.553665 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.553550 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\" (UniqueName: \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\") pod \"5188df56-7ecf-43b0-884d-3ce72cf193ad\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " Nov 03 17:45:20.553854 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.553723 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\") pod \"5188df56-7ecf-43b0-884d-3ce72cf193ad\" (UID: \"5188df56-7ecf-43b0-884d-3ce72cf193ad\") " Nov 03 17:45:20.554180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.554139 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca" pod "5188df56-7ecf-43b0-884d-3ce72cf193ad" (UID: "5188df56-7ecf-43b0-884d-3ce72cf193ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:45:20.555708 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.555681 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2" pod "5188df56-7ecf-43b0-884d-3ce72cf193ad" (UID: "5188df56-7ecf-43b0-884d-3ce72cf193ad"). InnerVolumeSpecName "kube-api-access-2cdc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:45:20.655168 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.655118 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdc2\" (UniqueName: \"kubernetes.io/projected/5188df56-7ecf-43b0-884d-3ce72cf193ad-kube-api-access-2cdc2\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:20.655168 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:20.655162 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5188df56-7ecf-43b0-884d-3ce72cf193ad-maas-api-service-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:21.251762 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:21.251722 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" event={"ID":"5188df56-7ecf-43b0-884d-3ce72cf193ad","Type":"ContainerDied","Data":"4cf8f768f8a0b747b7176c97e25df26d0ac7837f2dc29194bdef51b27e7c5e5e"} Nov 03 17:45:21.252148 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:21.252128 4557 scope.go:122] "RemoveContainer" containerID="42d4e914032198e39763f0eeeb94ab5eb30719297559fde337dde3044f564380" Nov 03 17:45:21.252367 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:21.252350 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58" Nov 03 17:45:21.542730 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:21.542635 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:21.578834 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:21.578789 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895465-chn58"] Nov 03 17:45:22.345427 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:22.345388 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" path="/var/lib/kubelet/pods/5188df56-7ecf-43b0-884d-3ce72cf193ad/volumes" Nov 03 17:45:30.436154 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.436112 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" podUID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" containerName="main" containerID="cri-o://76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0" gracePeriod=45 Nov 03 17:45:30.715524 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.715494 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:45:30.844964 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.844913 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845171 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.844983 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845171 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845085 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845171 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845133 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845437 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845173 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\" (UniqueName: \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845437 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845297 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\" (UniqueName: \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\") pod \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\" (UID: \"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa\") " Nov 03 17:45:30.845670 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845636 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:45:30.845898 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.845875 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:45:30.846078 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.846058 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:45:30.848361 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.848319 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "kube-api-access-hb55j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:45:30.848361 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.848327 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:45:30.848555 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.848413 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs" pod "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" (UID: "53855875-0c7f-4e12-8dce-cd6f4bbdd3aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:45:30.946645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946511 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb55j\" (UniqueName: \"kubernetes.io/projected/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-kube-api-access-hb55j\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:30.946645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946594 4557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-dshm\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:30.946645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946613 4557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-home\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:30.946645 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946628 4557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-model-cache\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:30.947008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946675 4557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tmp-dir\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:30.947008 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:30.946691 4557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa-tls-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:31.488024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.487984 4557 generic.go:356] "Generic (PLEG): container finished" podID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" containerID="76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0" exitCode=0 Nov 03 17:45:31.488556 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.488047 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" Nov 03 17:45:31.488556 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.488121 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" event={"ID":"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa","Type":"ContainerDied","Data":"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0"} Nov 03 17:45:31.488556 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.488162 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p" event={"ID":"53855875-0c7f-4e12-8dce-cd6f4bbdd3aa","Type":"ContainerDied","Data":"6f879172fc92340d6a87fb5d17ed7efb0013a742f58a79d43ecf2ea91ad262cb"} Nov 03 17:45:31.488556 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.488186 4557 scope.go:122] "RemoveContainer" containerID="76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0" Nov 03 17:45:31.502275 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.502203 4557 scope.go:122] "RemoveContainer" containerID="76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0" Nov 03 17:45:31.502679 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:31.502644 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0\": container with ID starting with 76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0 not found: ID does not exist" containerID="76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0" Nov 03 17:45:31.502771 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.502694 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0"} err="failed to get container status \"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0\": rpc error: code = NotFound desc = could not find container \"76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0\": container with ID starting with 76a5a785c70728f4a66eaae3f45fd191a05010729b3046a3bae2d94eb75a09e0 not found: ID does not exist" Nov 03 17:45:31.518615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.518074 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:45:31.522840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:31.522805 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-c8e6be7b-unmatched-kserve-56d9bf9bd6-f5l2p"] Nov 03 17:45:32.363593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:32.363057 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" path="/var/lib/kubelet/pods/53855875-0c7f-4e12-8dce-cd6f4bbdd3aa/volumes" Nov 03 17:45:32.945592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:32.943708 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:45:32.945592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:32.943799 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:45:33.010591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:33.010514 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:45:33.010790 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:33.010607 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:45:33.501592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:33.500683 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:45:33.501592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:33.500753 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:45:37.233834 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.233796 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9072-477215"] Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234165 4557 cpu_manager.go:414] "containerMap: removing container" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234176 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234188 4557 cpu_manager.go:414] "containerMap: removing container" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234193 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234205 4557 cpu_manager.go:414] "containerMap: removing container" podUID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" containerName="main" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234210 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" containerName="main" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234222 4557 cpu_manager.go:414] "containerMap: removing container" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234223 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234227 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234290 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234302 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234308 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="5188df56-7ecf-43b0-884d-3ce72cf193ad" containerName="cleanup" Nov 03 17:45:37.234469 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.234315 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="53855875-0c7f-4e12-8dce-cd6f4bbdd3aa" containerName="main" Nov 03 17:45:37.238227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.238209 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:37.242851 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.242653 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 17:45:37.242851 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.242786 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-477215"] Nov 03 17:45:37.243412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.243388 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 17:45:37.243541 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.243448 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-64x2h\"" Nov 03 17:45:37.285264 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.285227 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xckb7\" (UniqueName: \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\") pod \"test-curl-9072-477215\" (UID: \"78f5d079-0b5f-475f-b317-13b2b7a37bfc\") " pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:37.385817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.385782 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xckb7\" (UniqueName: \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\") pod \"test-curl-9072-477215\" (UID: \"78f5d079-0b5f-475f-b317-13b2b7a37bfc\") " pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:37.398056 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.398025 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xckb7\" (UniqueName: \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\") pod \"test-curl-9072-477215\" (UID: \"78f5d079-0b5f-475f-b317-13b2b7a37bfc\") " pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:37.551910 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.551832 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:37.827128 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.827102 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-477215"] Nov 03 17:45:37.828980 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:45:37.828941 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78f5d079_0b5f_475f_b317_13b2b7a37bfc.slice/crio-88050fce5268985288e5e856be0fafe2a588cb79fe414f38995edc8ae497b3e3 WatchSource:0}: Error finding container 88050fce5268985288e5e856be0fafe2a588cb79fe414f38995edc8ae497b3e3: Status 404 returned error can't find the container with id 88050fce5268985288e5e856be0fafe2a588cb79fe414f38995edc8ae497b3e3 Nov 03 17:45:37.838178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:37.838151 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:45:38.556591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:38.556529 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-477215" event={"ID":"78f5d079-0b5f-475f-b317-13b2b7a37bfc","Type":"ContainerStarted","Data":"88050fce5268985288e5e856be0fafe2a588cb79fe414f38995edc8ae497b3e3"} Nov 03 17:45:40.568762 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:40.568678 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-477215" event={"ID":"78f5d079-0b5f-475f-b317-13b2b7a37bfc","Type":"ContainerStarted","Data":"42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c"} Nov 03 17:45:40.586312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:40.586261 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9072-477215" podStartSLOduration=1.117847366 podStartE2EDuration="3.586248014s" totalImagesPullingTime="2.468400648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:40.585619272 +0000 UTC m=+972.422732097" watchObservedRunningTime="2026-11-03 17:45:40.586248014 +0000 UTC m=+972.423360835" Nov 03 17:45:41.307175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.307137 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9072-477215"] Nov 03 17:45:41.312092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.312061 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9072-477215"] Nov 03 17:45:41.623044 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.622964 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9072-5f0f24"] Nov 03 17:45:41.623409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.623360 4557 cpu_manager.go:414] "containerMap: removing container" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" containerName="test-curl-9072-477215" Nov 03 17:45:41.623409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.623371 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" containerName="test-curl-9072-477215" Nov 03 17:45:41.623479 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.623447 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" containerName="test-curl-9072-477215" Nov 03 17:45:41.626808 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.626791 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:41.633937 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.633807 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-5f0f24"] Nov 03 17:45:41.722758 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.722719 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxr6\" (UniqueName: \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\") pod \"test-curl-9072-5f0f24\" (UID: \"501a2447-8fe7-4514-b979-b81e40f5e687\") " pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:41.823334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.823300 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxr6\" (UniqueName: \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\") pod \"test-curl-9072-5f0f24\" (UID: \"501a2447-8fe7-4514-b979-b81e40f5e687\") " pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:41.836290 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.836255 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxr6\" (UniqueName: \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\") pod \"test-curl-9072-5f0f24\" (UID: \"501a2447-8fe7-4514-b979-b81e40f5e687\") " pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:41.939296 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:41.939260 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:42.217808 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:42.217778 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-5f0f24"] Nov 03 17:45:42.219762 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:45:42.219738 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod501a2447_8fe7_4514_b979_b81e40f5e687.slice/crio-04b4997002bf4da0a66f0cf09995ca1e8dc197a474e864dd6a01f1f7b7dd9048 WatchSource:0}: Error finding container 04b4997002bf4da0a66f0cf09995ca1e8dc197a474e864dd6a01f1f7b7dd9048: Status 404 returned error can't find the container with id 04b4997002bf4da0a66f0cf09995ca1e8dc197a474e864dd6a01f1f7b7dd9048 Nov 03 17:45:42.580706 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:42.580621 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-5f0f24" event={"ID":"501a2447-8fe7-4514-b979-b81e40f5e687","Type":"ContainerStarted","Data":"c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e"} Nov 03 17:45:42.580706 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:42.580670 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-5f0f24" event={"ID":"501a2447-8fe7-4514-b979-b81e40f5e687","Type":"ContainerStarted","Data":"04b4997002bf4da0a66f0cf09995ca1e8dc197a474e864dd6a01f1f7b7dd9048"} Nov 03 17:45:42.580939 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:42.580796 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9072-477215" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" containerName="test-curl-9072-477215" containerID="cri-o://42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c" gracePeriod=2 Nov 03 17:45:42.600651 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:42.600603 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9072-5f0f24" podStartSLOduration=1.600557843 podStartE2EDuration="1.600557843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:42.598541575 +0000 UTC m=+974.435654400" watchObservedRunningTime="2026-11-03 17:45:42.600557843 +0000 UTC m=+974.437670667" Nov 03 17:45:43.270050 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.270012 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9072-5f0f24"] Nov 03 17:45:43.275705 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.275677 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9072-5f0f24"] Nov 03 17:45:43.523139 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.523057 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9072-fa9a72"] Nov 03 17:45:43.523458 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.523445 4557 cpu_manager.go:414] "containerMap: removing container" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" containerName="test-curl-9072-5f0f24" Nov 03 17:45:43.523500 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.523459 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" containerName="test-curl-9072-5f0f24" Nov 03 17:45:43.523540 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.523532 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" containerName="test-curl-9072-5f0f24" Nov 03 17:45:43.526722 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.526704 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:43.534435 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.534249 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-fa9a72"] Nov 03 17:45:43.540162 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.540133 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xpb\" (UniqueName: \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\") pod \"test-curl-9072-fa9a72\" (UID: \"5f613387-9145-443c-b547-49f92edf6d0e\") " pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:43.640999 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.640955 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xpb\" (UniqueName: \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\") pod \"test-curl-9072-fa9a72\" (UID: \"5f613387-9145-443c-b547-49f92edf6d0e\") " pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:43.654026 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.653994 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xpb\" (UniqueName: \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\") pod \"test-curl-9072-fa9a72\" (UID: \"5f613387-9145-443c-b547-49f92edf6d0e\") " pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:43.839945 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:43.839848 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:44.112982 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.112958 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-fa9a72"] Nov 03 17:45:44.114543 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:45:44.114518 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f613387_9145_443c_b547_49f92edf6d0e.slice/crio-d3fe00fa4bb34588ac072dcd9155a3a083eef8c20c368295eae7fbbc752076ae WatchSource:0}: Error finding container d3fe00fa4bb34588ac072dcd9155a3a083eef8c20c368295eae7fbbc752076ae: Status 404 returned error can't find the container with id d3fe00fa4bb34588ac072dcd9155a3a083eef8c20c368295eae7fbbc752076ae Nov 03 17:45:44.592091 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.592056 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-fa9a72" event={"ID":"5f613387-9145-443c-b547-49f92edf6d0e","Type":"ContainerStarted","Data":"b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f"} Nov 03 17:45:44.592420 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.592106 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-fa9a72" event={"ID":"5f613387-9145-443c-b547-49f92edf6d0e","Type":"ContainerStarted","Data":"d3fe00fa4bb34588ac072dcd9155a3a083eef8c20c368295eae7fbbc752076ae"} Nov 03 17:45:44.592420 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.592187 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9072-5f0f24" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" containerName="test-curl-9072-5f0f24" containerID="cri-o://c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e" gracePeriod=2 Nov 03 17:45:44.611197 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.611132 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9072-fa9a72" podStartSLOduration=1.611117472 podStartE2EDuration="1.611117472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:44.608355053 +0000 UTC m=+976.445467880" watchObservedRunningTime="2026-11-03 17:45:44.611117472 +0000 UTC m=+976.448230295" Nov 03 17:45:44.751750 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.751720 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:44.853458 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.853369 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\" (UniqueName: \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\") pod \"78f5d079-0b5f-475f-b317-13b2b7a37bfc\" (UID: \"78f5d079-0b5f-475f-b317-13b2b7a37bfc\") " Nov 03 17:45:44.855461 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.855433 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7" pod "78f5d079-0b5f-475f-b317-13b2b7a37bfc" (UID: "78f5d079-0b5f-475f-b317-13b2b7a37bfc"). InnerVolumeSpecName "kube-api-access-xckb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:45:44.954322 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:44.954263 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xckb7\" (UniqueName: \"kubernetes.io/projected/78f5d079-0b5f-475f-b317-13b2b7a37bfc-kube-api-access-xckb7\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:45.598236 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:45.598202 4557 generic.go:356] "Generic (PLEG): container finished" podID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" containerID="42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c" exitCode=137 Nov 03 17:45:45.598757 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:45.598257 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:45.598757 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:45.598292 4557 scope.go:122] "RemoveContainer" containerID="42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c" Nov 03 17:45:45.608185 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:45.608165 4557 scope.go:122] "RemoveContainer" containerID="42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c" Nov 03 17:45:45.608469 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:45.608450 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c\": container with ID starting with 42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c not found: ID does not exist" containerID="42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c" Nov 03 17:45:45.608524 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:45.608481 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c"} err="failed to get container status \"42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c\": rpc error: code = NotFound desc = could not find container \"42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c\": container with ID starting with 42bf0aeb3c5a627dc2ee8c03eee1c959995fb2cf61fa2fe1f49bc1a30c6bc08c not found: ID does not exist" Nov 03 17:45:45.610257 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:45.610239 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-477215\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" pod="opendatahub/test-curl-9072-477215" Nov 03 17:45:46.322327 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:46.322296 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78f5d079-0b5f-475f-b317-13b2b7a37bfc" path="/var/lib/kubelet/pods/78f5d079-0b5f-475f-b317-13b2b7a37bfc/volumes" Nov 03 17:45:46.785825 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:46.785800 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:46.869971 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:46.869875 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\" (UniqueName: \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\") pod \"501a2447-8fe7-4514-b979-b81e40f5e687\" (UID: \"501a2447-8fe7-4514-b979-b81e40f5e687\") " Nov 03 17:45:46.871946 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:46.871914 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6" pod "501a2447-8fe7-4514-b979-b81e40f5e687" (UID: "501a2447-8fe7-4514-b979-b81e40f5e687"). InnerVolumeSpecName "kube-api-access-dzxr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:45:46.970953 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:46.970922 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzxr6\" (UniqueName: \"kubernetes.io/projected/501a2447-8fe7-4514-b979-b81e40f5e687-kube-api-access-dzxr6\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:47.610528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:47.610490 4557 generic.go:356] "Generic (PLEG): container finished" podID="501a2447-8fe7-4514-b979-b81e40f5e687" containerID="c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e" exitCode=137 Nov 03 17:45:47.610528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:47.610528 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:47.610792 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:47.610592 4557 scope.go:122] "RemoveContainer" containerID="c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e" Nov 03 17:45:47.619047 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:47.619031 4557 scope.go:122] "RemoveContainer" containerID="c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e" Nov 03 17:45:47.619297 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:47.619279 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e\": container with ID starting with c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e not found: ID does not exist" containerID="c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e" Nov 03 17:45:47.619343 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:47.619307 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e"} err="failed to get container status \"c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e\": rpc error: code = NotFound desc = could not find container \"c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e\": container with ID starting with c5a84345031f413a6c36fd6958c908171577e1bc3cc3af847a00e48b81be273e not found: ID does not exist" Nov 03 17:45:47.621791 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:47.621769 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-5f0f24\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:48.322515 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:48.322481 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-5f0f24\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" pod="opendatahub/test-curl-9072-5f0f24" Nov 03 17:45:48.322919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:48.322802 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="501a2447-8fe7-4514-b979-b81e40f5e687" path="/var/lib/kubelet/pods/501a2447-8fe7-4514-b979-b81e40f5e687/volumes" Nov 03 17:45:49.414343 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:49.414308 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:45:54.870201 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:54.870158 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9072-fa9a72"] Nov 03 17:45:54.870824 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:54.870394 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9072-fa9a72" podUID="5f613387-9145-443c-b547-49f92edf6d0e" containerName="test-curl-9072-fa9a72" containerID="cri-o://b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f" gracePeriod=2 Nov 03 17:45:54.873230 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:54.873194 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-fa9a72\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="5f613387-9145-443c-b547-49f92edf6d0e" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:54.874730 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:54.874704 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9072-fa9a72"] Nov 03 17:45:57.028156 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.028127 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9072-1c2a40"] Nov 03 17:45:57.028534 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.028520 4557 cpu_manager.go:414] "containerMap: removing container" podUID="5f613387-9145-443c-b547-49f92edf6d0e" containerName="test-curl-9072-fa9a72" Nov 03 17:45:57.028598 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.028536 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f613387-9145-443c-b547-49f92edf6d0e" containerName="test-curl-9072-fa9a72" Nov 03 17:45:57.028666 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.028655 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f613387-9145-443c-b547-49f92edf6d0e" containerName="test-curl-9072-fa9a72" Nov 03 17:45:57.031809 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.031791 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:45:57.039665 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.039639 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-1c2a40"] Nov 03 17:45:57.050864 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.050840 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:57.165640 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.165526 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\" (UniqueName: \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\") pod \"5f613387-9145-443c-b547-49f92edf6d0e\" (UID: \"5f613387-9145-443c-b547-49f92edf6d0e\") " Nov 03 17:45:57.165780 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.165741 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c444q\" (UniqueName: \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\") pod \"test-curl-9072-1c2a40\" (UID: \"16c2712c-6a35-4a41-a128-7d17157f2ac9\") " pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:45:57.167612 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.167591 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb" pod "5f613387-9145-443c-b547-49f92edf6d0e" (UID: "5f613387-9145-443c-b547-49f92edf6d0e"). InnerVolumeSpecName "kube-api-access-q5xpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:45:57.267239 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.267203 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c444q\" (UniqueName: \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\") pod \"test-curl-9072-1c2a40\" (UID: \"16c2712c-6a35-4a41-a128-7d17157f2ac9\") " pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:45:57.267415 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.267317 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5xpb\" (UniqueName: \"kubernetes.io/projected/5f613387-9145-443c-b547-49f92edf6d0e-kube-api-access-q5xpb\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:45:57.279777 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.279745 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c444q\" (UniqueName: \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\") pod \"test-curl-9072-1c2a40\" (UID: \"16c2712c-6a35-4a41-a128-7d17157f2ac9\") " pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:45:57.358169 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.358127 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:45:57.637819 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.637793 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-1c2a40"] Nov 03 17:45:57.639644 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:45:57.639612 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16c2712c_6a35_4a41_a128_7d17157f2ac9.slice/crio-0381cdaaec6adbc61259e1eae6a6775bc9c589c792989bfbb88521ba29838603 WatchSource:0}: Error finding container 0381cdaaec6adbc61259e1eae6a6775bc9c589c792989bfbb88521ba29838603: Status 404 returned error can't find the container with id 0381cdaaec6adbc61259e1eae6a6775bc9c589c792989bfbb88521ba29838603 Nov 03 17:45:57.663215 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.663189 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-1c2a40" event={"ID":"16c2712c-6a35-4a41-a128-7d17157f2ac9","Type":"ContainerStarted","Data":"0381cdaaec6adbc61259e1eae6a6775bc9c589c792989bfbb88521ba29838603"} Nov 03 17:45:57.664269 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.664245 4557 generic.go:356] "Generic (PLEG): container finished" podID="5f613387-9145-443c-b547-49f92edf6d0e" containerID="b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f" exitCode=137 Nov 03 17:45:57.664360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.664287 4557 scope.go:122] "RemoveContainer" containerID="b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f" Nov 03 17:45:57.664360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.664287 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:57.672804 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.672781 4557 scope.go:122] "RemoveContainer" containerID="b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f" Nov 03 17:45:57.673136 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:57.673115 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f\": container with ID starting with b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f not found: ID does not exist" containerID="b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f" Nov 03 17:45:57.673210 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:57.673145 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f"} err="failed to get container status \"b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f\": rpc error: code = NotFound desc = could not find container \"b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f\": container with ID starting with b0ff66481080bedc1efad2e4091eb46ce2157cb561dff172056e315304dd737f not found: ID does not exist" Nov 03 17:45:57.694454 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:57.694429 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-fa9a72\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="5f613387-9145-443c-b547-49f92edf6d0e" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:58.322805 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:45:58.322765 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-fa9a72\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="5f613387-9145-443c-b547-49f92edf6d0e" pod="opendatahub/test-curl-9072-fa9a72" Nov 03 17:45:58.324046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:58.324021 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f613387-9145-443c-b547-49f92edf6d0e" path="/var/lib/kubelet/pods/5f613387-9145-443c-b547-49f92edf6d0e/volumes" Nov 03 17:45:58.673109 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:58.673072 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-1c2a40" event={"ID":"16c2712c-6a35-4a41-a128-7d17157f2ac9","Type":"ContainerStarted","Data":"f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f"} Nov 03 17:45:58.689815 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:58.689765 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9072-1c2a40" podStartSLOduration=1.6897523749999999 podStartE2EDuration="1.689752375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:58.689156791 +0000 UTC m=+990.526269613" watchObservedRunningTime="2026-11-03 17:45:58.689752375 +0000 UTC m=+990.526865199" Nov 03 17:45:59.352702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:59.352664 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9072-1c2a40"] Nov 03 17:45:59.355407 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:45:59.355378 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9072-1c2a40"] Nov 03 17:46:00.684609 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:00.684555 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9072-1c2a40" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" containerName="test-curl-9072-1c2a40" containerID="cri-o://f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f" gracePeriod=2 Nov 03 17:46:02.861066 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:02.861039 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:46:02.923160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:02.923130 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\" (UniqueName: \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\") pod \"16c2712c-6a35-4a41-a128-7d17157f2ac9\" (UID: \"16c2712c-6a35-4a41-a128-7d17157f2ac9\") " Nov 03 17:46:02.925256 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:02.925221 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q" pod "16c2712c-6a35-4a41-a128-7d17157f2ac9" (UID: "16c2712c-6a35-4a41-a128-7d17157f2ac9"). InnerVolumeSpecName "kube-api-access-c444q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:46:03.024289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.024196 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c444q\" (UniqueName: \"kubernetes.io/projected/16c2712c-6a35-4a41-a128-7d17157f2ac9-kube-api-access-c444q\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:46:03.703583 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.703539 4557 generic.go:356] "Generic (PLEG): container finished" podID="16c2712c-6a35-4a41-a128-7d17157f2ac9" containerID="f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f" exitCode=137 Nov 03 17:46:03.703769 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.703605 4557 scope.go:122] "RemoveContainer" containerID="f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f" Nov 03 17:46:03.703769 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.703609 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:46:03.712523 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.712500 4557 scope.go:122] "RemoveContainer" containerID="f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f" Nov 03 17:46:03.712905 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:46:03.712880 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f\": container with ID starting with f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f not found: ID does not exist" containerID="f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f" Nov 03 17:46:03.713003 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:03.712914 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f"} err="failed to get container status \"f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f\": rpc error: code = NotFound desc = could not find container \"f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f\": container with ID starting with f98e6a604dd97385cd6a4c443ed445a9f17f70f19c39d4e949e4f60a8c400c6f not found: ID does not exist" Nov 03 17:46:03.715220 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:46:03.715197 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-1c2a40\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" pod="opendatahub/test-curl-9072-1c2a40" Nov 03 17:46:04.323729 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:04.323697 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" path="/var/lib/kubelet/pods/16c2712c-6a35-4a41-a128-7d17157f2ac9/volumes" Nov 03 17:46:10.297328 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.297288 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:46:10.297834 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.297815 4557 cpu_manager.go:414] "containerMap: removing container" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" containerName="test-curl-9072-1c2a40" Nov 03 17:46:10.297919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.297836 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" containerName="test-curl-9072-1c2a40" Nov 03 17:46:10.297971 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.297920 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="16c2712c-6a35-4a41-a128-7d17157f2ac9" containerName="test-curl-9072-1c2a40" Nov 03 17:46:10.302830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.302811 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.307801 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.307780 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-main-e930f1-openshift-default-dockercfg-8jcml\"" Nov 03 17:46:10.328120 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.328089 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:46:10.400768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.400728 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.400949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.400780 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.400949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.400858 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.400949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.400919 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.401053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.400990 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx74z\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.401053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.401025 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.401053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.401050 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.401146 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.401124 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.401179 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.401155 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501668 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501632 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501697 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501728 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501767 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501802 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx74z\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.501860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501834 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502130 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501885 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502130 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501924 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502130 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.501975 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502334 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.502179 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.502456 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.502474 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.502499 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.502629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.502500 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.504617 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.504585 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.504880 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.504854 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.514591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.514553 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.514709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.514589 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx74z\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\") pod \"e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.615538 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.615452 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:10.896554 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.896520 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:46:10.898941 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:46:10.898907 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2562ad01_b4d5_4ace_819e_8ef27a379f74.slice/crio-3080b12f0996ce8eecb906163374b3896aa2950240c013f2bbb0da4e8b476b39 WatchSource:0}: Error finding container 3080b12f0996ce8eecb906163374b3896aa2950240c013f2bbb0da4e8b476b39: Status 404 returned error can't find the container with id 3080b12f0996ce8eecb906163374b3896aa2950240c013f2bbb0da4e8b476b39 Nov 03 17:46:10.902351 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.902318 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:10.902450 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.902387 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:10.902450 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:10.902414 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:11.747659 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:11.747617 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerStarted","Data":"cc4cea1ab528fee0cfabf8122f8f1da0cc12501eeef72a96ed659eeb4a93b1ed"} Nov 03 17:46:11.748126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:11.747707 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerStarted","Data":"3080b12f0996ce8eecb906163374b3896aa2950240c013f2bbb0da4e8b476b39"} Nov 03 17:46:11.775748 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:11.775693 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podStartSLOduration=1.775680247 podStartE2EDuration="1.775680247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:46:11.773270861 +0000 UTC m=+1003.610383687" watchObservedRunningTime="2026-11-03 17:46:11.775680247 +0000 UTC m=+1003.612793128" Nov 03 17:46:12.615630 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:12.615591 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:12.620516 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:12.620487 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:12.753350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:12.753317 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:12.754463 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:12.754445 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:19.415735 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:46:19.415697 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:46:27.895908 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:27.895001 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:44542->10.132.0.55:15021: read: connection reset by peer" start-of-body= Nov 03 17:46:27.895908 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:27.895072 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:44542->10.132.0.55:15021: read: connection reset by peer" Nov 03 17:46:28.838088 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.838051 4557 generic.go:356] "Generic (PLEG): container finished" podID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerID="cc4cea1ab528fee0cfabf8122f8f1da0cc12501eeef72a96ed659eeb4a93b1ed" exitCode=0 Nov 03 17:46:28.838260 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.838123 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerDied","Data":"cc4cea1ab528fee0cfabf8122f8f1da0cc12501eeef72a96ed659eeb4a93b1ed"} Nov 03 17:46:28.838523 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.838508 4557 scope.go:122] "RemoveContainer" containerID="cc4cea1ab528fee0cfabf8122f8f1da0cc12501eeef72a96ed659eeb4a93b1ed" Nov 03 17:46:28.839618 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.839594 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:28.839670 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.839659 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:28.839707 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:28.839691 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:29.849900 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:29.849863 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerStarted","Data":"393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248"} Nov 03 17:46:30.616626 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:30.616560 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:30.616832 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:30.616809 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 17:46:30.616887 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:30.616859 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 17:46:31.616882 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:31.616842 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 17:46:31.617330 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:31.616922 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 17:46:32.616254 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:32.616217 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 17:46:32.616443 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:32.616282 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 17:46:33.616352 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:33.616314 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 17:46:33.616810 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:33.616370 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 17:46:34.616518 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:34.616479 4557 patch_prober.go:29] interesting pod/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 17:46:34.616957 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:34.616554 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 17:46:35.620271 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:35.620237 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:35.620776 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:35.620661 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:35.621406 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:35.621390 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:46:42.009341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.009261 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:46:42.013627 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.013603 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.022887 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.022857 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-main-ed6b15-openshift-default-dockercfg-8798r\"" Nov 03 17:46:42.026761 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.026727 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:46:42.151820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.151765 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.151820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.151828 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152071 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.151940 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152071 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152016 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152071 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152055 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152209 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152187 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152246 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152222 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152293 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152263 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5dc\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.152349 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.152336 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253382 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253332 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5dc\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253495 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253532 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253554 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253596 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253652 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253696 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253814 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253755 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253814 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253778 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.253984 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.253960 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.254139 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.254057 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.254206 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.254172 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.254265 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.254234 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.254354 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.254335 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.255870 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.255848 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.256281 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.256266 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.269076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.269008 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.269178 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.269099 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5dc\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\") pod \"e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.330732 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.330638 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:42.616437 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.616410 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:46:42.618053 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:46:42.618024 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b70a79a_a132_4ce3_ab4e_25d354fd2b65.slice/crio-e48832d1667341caca2feb91ba6c44600a06733267d72fe4944b1c9880eb32c8 WatchSource:0}: Error finding container e48832d1667341caca2feb91ba6c44600a06733267d72fe4944b1c9880eb32c8: Status 404 returned error can't find the container with id e48832d1667341caca2feb91ba6c44600a06733267d72fe4944b1c9880eb32c8 Nov 03 17:46:42.620345 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.620315 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:42.620404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.620377 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:42.620439 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.620406 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:46:42.918131 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.918097 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerStarted","Data":"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2"} Nov 03 17:46:42.918298 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.918152 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerStarted","Data":"e48832d1667341caca2feb91ba6c44600a06733267d72fe4944b1c9880eb32c8"} Nov 03 17:46:42.943954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:42.943898 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podStartSLOduration=1.9438835380000001 podStartE2EDuration="1.943883538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:46:42.940724692 +0000 UTC m=+1034.777837517" watchObservedRunningTime="2026-11-03 17:46:42.943883538 +0000 UTC m=+1034.780996362" Nov 03 17:46:43.331548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:43.331447 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:43.337054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:43.337031 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:43.924140 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:43.924109 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:43.925373 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:43.925348 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:46:49.418679 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:46:49.418643 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:46:59.965738 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:59.965694 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:46:59.966278 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:46:59.965770 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:47:02.032095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.032061 4557 generic.go:356] "Generic (PLEG): container finished" podID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerID="8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2" exitCode=0 Nov 03 17:47:02.032548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.032136 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerDied","Data":"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2"} Nov 03 17:47:02.032548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.032532 4557 scope.go:122] "RemoveContainer" containerID="8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2" Nov 03 17:47:02.033776 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.033742 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:47:02.033840 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.033817 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:47:02.033872 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:02.033855 4557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 03 17:47:03.047705 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:03.047661 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerStarted","Data":"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca"} Nov 03 17:47:03.334129 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:03.333959 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:47:03.336822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:03.335683 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 03 17:47:03.336822 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:03.335742 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 03 17:47:04.337393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:04.337344 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 03 17:47:04.338545 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:04.338166 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 03 17:47:05.342709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:05.342670 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 03 17:47:05.343286 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:05.343257 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 03 17:47:06.340817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:06.340776 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 03 17:47:06.341145 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:06.341112 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 03 17:47:07.332594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:07.331949 4557 patch_prober.go:29] interesting pod/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 03 17:47:07.332594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:07.332024 4557 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 03 17:47:08.560709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:08.560676 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:47:08.561549 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:08.561519 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:47:08.562603 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:08.562584 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:47:19.415209 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:47:19.415168 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:47:33.979954 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.979913 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9072-843d80"] Nov 03 17:47:33.983602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.983558 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:33.987683 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.987651 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-64x2h\"" Nov 03 17:47:33.988445 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.988420 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 17:47:33.988660 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.988640 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 17:47:33.988759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:33.988739 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-843d80"] Nov 03 17:47:34.172048 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:34.172014 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdczk\" (UniqueName: \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\") pod \"test-curl-9072-843d80\" (UID: \"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8\") " pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:34.273333 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:34.273245 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdczk\" (UniqueName: \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\") pod \"test-curl-9072-843d80\" (UID: \"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8\") " pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:34.285942 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:34.285910 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdczk\" (UniqueName: \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\") pod \"test-curl-9072-843d80\" (UID: \"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8\") " pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:34.297787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:34.297761 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:34.575674 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:34.575520 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9072-843d80"] Nov 03 17:47:34.582065 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:47:34.582012 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9634e53c_0bbc_4b7b_9a8d_ff5c0ac7a6d8.slice/crio-e7f0182e1b06b1a189a0120dd11cb4f78d08b4e3b57ec04b87c98442286f1f93 WatchSource:0}: Error finding container e7f0182e1b06b1a189a0120dd11cb4f78d08b4e3b57ec04b87c98442286f1f93: Status 404 returned error can't find the container with id e7f0182e1b06b1a189a0120dd11cb4f78d08b4e3b57ec04b87c98442286f1f93 Nov 03 17:47:35.223927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:35.223892 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-843d80" event={"ID":"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8","Type":"ContainerStarted","Data":"1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b"} Nov 03 17:47:35.223927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:35.223934 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9072-843d80" event={"ID":"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8","Type":"ContainerStarted","Data":"e7f0182e1b06b1a189a0120dd11cb4f78d08b4e3b57ec04b87c98442286f1f93"} Nov 03 17:47:35.241770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:35.241719 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9072-843d80" podStartSLOduration=2.241706235 podStartE2EDuration="2.241706235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:47:35.240153413 +0000 UTC m=+1087.077266237" watchObservedRunningTime="2026-11-03 17:47:35.241706235 +0000 UTC m=+1087.078819058" Nov 03 17:47:35.938066 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:35.938027 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9072-843d80"] Nov 03 17:47:35.942301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:35.942275 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9072-843d80"] Nov 03 17:47:36.749846 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.749807 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt"] Nov 03 17:47:36.750219 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.750195 4557 cpu_manager.go:414] "containerMap: removing container" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" containerName="test-curl-9072-843d80" Nov 03 17:47:36.750219 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.750205 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" containerName="test-curl-9072-843d80" Nov 03 17:47:36.750303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.750292 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" containerName="test-curl-9072-843d80" Nov 03 17:47:36.753515 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.753499 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.761303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.761267 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:47:36.761303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.761294 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:47:36.761488 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.761351 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:47:36.761488 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.761352 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:47:36.764537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.764512 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt"] Nov 03 17:47:36.897915 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.897873 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62hx\" (UniqueName: \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.898096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.897928 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.898096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.898019 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.998860 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.998816 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62hx\" (UniqueName: \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.999053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.998877 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.999053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.998907 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:36.999498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:36.999468 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:37.001306 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:37.001247 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:37.011650 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:37.011620 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62hx\" (UniqueName: \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\") pod \"maas-api-revoke-sub-f55b50db-dzxnt\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:37.067513 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:37.067478 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:37.233257 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:37.233213 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9072-843d80" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" containerName="test-curl-9072-843d80" containerID="cri-o://1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b" gracePeriod=2 Nov 03 17:47:37.341985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:37.341954 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt"] Nov 03 17:47:37.343350 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:47:37.343325 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f9e0b7_3010_4355_af5a_c71d293c5d5e.slice/crio-71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58 WatchSource:0}: Error finding container 71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58: Status 404 returned error can't find the container with id 71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58 Nov 03 17:47:38.240161 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:38.240131 4557 generic.go:356] "Generic (PLEG): container finished" podID="c8f9e0b7-3010-4355-af5a-c71d293c5d5e" containerID="aedc683aa4f43c9984207caf7cdf49241d7d1b698bc20a93a487713d9ccc4eff" exitCode=0 Nov 03 17:47:38.240546 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:38.240214 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" event={"ID":"c8f9e0b7-3010-4355-af5a-c71d293c5d5e","Type":"ContainerDied","Data":"aedc683aa4f43c9984207caf7cdf49241d7d1b698bc20a93a487713d9ccc4eff"} Nov 03 17:47:38.240546 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:38.240270 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" event={"ID":"c8f9e0b7-3010-4355-af5a-c71d293c5d5e","Type":"ContainerStarted","Data":"71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58"} Nov 03 17:47:39.396755 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.396729 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:39.421960 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.421925 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\") pod \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " Nov 03 17:47:39.422126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.422045 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\" (UniqueName: \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\") pod \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " Nov 03 17:47:39.422181 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.422129 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\") pod \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\" (UID: \"c8f9e0b7-3010-4355-af5a-c71d293c5d5e\") " Nov 03 17:47:39.422631 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.422601 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca" pod "c8f9e0b7-3010-4355-af5a-c71d293c5d5e" (UID: "c8f9e0b7-3010-4355-af5a-c71d293c5d5e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:47:39.424754 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.424725 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca" pod "c8f9e0b7-3010-4355-af5a-c71d293c5d5e" (UID: "c8f9e0b7-3010-4355-af5a-c71d293c5d5e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:47:39.424855 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.424752 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx" pod "c8f9e0b7-3010-4355-af5a-c71d293c5d5e" (UID: "c8f9e0b7-3010-4355-af5a-c71d293c5d5e"). InnerVolumeSpecName "kube-api-access-s62hx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:47:39.433033 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.433009 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:39.523046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.522959 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\" (UniqueName: \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\") pod \"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8\" (UID: \"9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8\") " Nov 03 17:47:39.523196 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.523163 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:39.523196 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.523175 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:39.523196 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.523184 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s62hx\" (UniqueName: \"kubernetes.io/projected/c8f9e0b7-3010-4355-af5a-c71d293c5d5e-kube-api-access-s62hx\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:39.525024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.524993 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk" pod "9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" (UID: "9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8"). InnerVolumeSpecName "kube-api-access-gdczk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:47:39.623897 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:39.623861 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdczk\" (UniqueName: \"kubernetes.io/projected/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8-kube-api-access-gdczk\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:40.253188 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.253157 4557 generic.go:356] "Generic (PLEG): container finished" podID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" containerID="1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b" exitCode=137 Nov 03 17:47:40.253330 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.253201 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:40.253330 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.253253 4557 scope.go:122] "RemoveContainer" containerID="1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b" Nov 03 17:47:40.254664 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.254640 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" Nov 03 17:47:40.254799 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.254685 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt" event={"ID":"c8f9e0b7-3010-4355-af5a-c71d293c5d5e","Type":"ContainerDied","Data":"71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58"} Nov 03 17:47:40.254799 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.254766 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71bc4bbe870fccf7440f7146e4be291476ece9f95ce26042aa74b44e470c7c58" Nov 03 17:47:40.262705 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.262626 4557 scope.go:122] "RemoveContainer" containerID="1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b" Nov 03 17:47:40.263007 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:47:40.262982 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b\": container with ID starting with 1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b not found: ID does not exist" containerID="1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b" Nov 03 17:47:40.263105 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.263017 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b"} err="failed to get container status \"1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b\": rpc error: code = NotFound desc = could not find container \"1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b\": container with ID starting with 1fdb8cccaccc735ecd157f548d9de78f0c072dde3eaaf181c28f238aaa990a9b not found: ID does not exist" Nov 03 17:47:40.267400 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:47:40.267372 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-843d80\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:40.273348 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:47:40.273316 4557 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9072-843d80\" is forbidden: User \"system:node:ip-10-0-141-130.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-130.us-east-2.compute.internal' and this object" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" pod="opendatahub/test-curl-9072-843d80" Nov 03 17:47:40.322444 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:40.322414 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8" path="/var/lib/kubelet/pods/9634e53c-0bbc-4b7b-9a8d-ff5c0ac7a6d8/volumes" Nov 03 17:47:49.416606 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:47:49.416552 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:47:50.089215 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.089178 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg"] Nov 03 17:47:50.089689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.089665 4557 cpu_manager.go:414] "containerMap: removing container" podUID="c8f9e0b7-3010-4355-af5a-c71d293c5d5e" containerName="revoke-keys" Nov 03 17:47:50.089689 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.089683 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f9e0b7-3010-4355-af5a-c71d293c5d5e" containerName="revoke-keys" Nov 03 17:47:50.089866 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.089752 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8f9e0b7-3010-4355-af5a-c71d293c5d5e" containerName="revoke-keys" Nov 03 17:47:50.094786 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.094765 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.099758 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.099731 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:47:50.102548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.102514 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:47:50.102702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.102640 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:47:50.102818 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.102751 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:47:50.105655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.105630 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg"] Nov 03 17:47:50.126368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.126329 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.126714 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.126660 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.126893 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.126754 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbm9\" (UniqueName: \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.227883 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.227843 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.228060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.227898 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.228060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.227930 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbm9\" (UniqueName: \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.228859 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.228835 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.230940 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.230917 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.241543 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.241518 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbm9\" (UniqueName: \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\") pod \"maas-api-revoke-sub-a1dc6fd9-5wzkg\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.412308 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.412212 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:50.707509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:50.707477 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg"] Nov 03 17:47:50.709171 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:47:50.709143 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b6d628_3425_4976_8d6e_8311462147aa.slice/crio-cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b WatchSource:0}: Error finding container cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b: Status 404 returned error can't find the container with id cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b Nov 03 17:47:51.314668 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:51.314629 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" event={"ID":"77b6d628-3425-4976-8d6e-8311462147aa","Type":"ContainerStarted","Data":"923d7b0d8cb2294ee03b6912b6f7e2ffa047d8f94734a86c116aca18abfae98e"} Nov 03 17:47:51.314885 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:51.314694 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" event={"ID":"77b6d628-3425-4976-8d6e-8311462147aa","Type":"ContainerStarted","Data":"cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b"} Nov 03 17:47:51.335460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:51.335405 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" podStartSLOduration=1.335390853 podStartE2EDuration="1.335390853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:47:51.333367101 +0000 UTC m=+1103.170479950" watchObservedRunningTime="2026-11-03 17:47:51.335390853 +0000 UTC m=+1103.172503677" Nov 03 17:47:52.321947 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:52.321917 4557 generic.go:356] "Generic (PLEG): container finished" podID="77b6d628-3425-4976-8d6e-8311462147aa" containerID="923d7b0d8cb2294ee03b6912b6f7e2ffa047d8f94734a86c116aca18abfae98e" exitCode=0 Nov 03 17:47:52.322341 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:52.322028 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" event={"ID":"77b6d628-3425-4976-8d6e-8311462147aa","Type":"ContainerDied","Data":"923d7b0d8cb2294ee03b6912b6f7e2ffa047d8f94734a86c116aca18abfae98e"} Nov 03 17:47:53.464076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.464047 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:53.567532 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.567501 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\" (UniqueName: \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\") pod \"77b6d628-3425-4976-8d6e-8311462147aa\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " Nov 03 17:47:53.567736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.567561 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\") pod \"77b6d628-3425-4976-8d6e-8311462147aa\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " Nov 03 17:47:53.567736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.567611 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\") pod \"77b6d628-3425-4976-8d6e-8311462147aa\" (UID: \"77b6d628-3425-4976-8d6e-8311462147aa\") " Nov 03 17:47:53.568049 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.568018 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca" pod "77b6d628-3425-4976-8d6e-8311462147aa" (UID: "77b6d628-3425-4976-8d6e-8311462147aa"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:47:53.569724 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.569700 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9" pod "77b6d628-3425-4976-8d6e-8311462147aa" (UID: "77b6d628-3425-4976-8d6e-8311462147aa"). InnerVolumeSpecName "kube-api-access-4dbm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:47:53.569724 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.569708 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca" pod "77b6d628-3425-4976-8d6e-8311462147aa" (UID: "77b6d628-3425-4976-8d6e-8311462147aa"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:47:53.669356 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.669322 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dbm9\" (UniqueName: \"kubernetes.io/projected/77b6d628-3425-4976-8d6e-8311462147aa-kube-api-access-4dbm9\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:53.669356 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.669357 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:53.669543 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:53.669370 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/77b6d628-3425-4976-8d6e-8311462147aa-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:47:54.333653 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:54.333618 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" event={"ID":"77b6d628-3425-4976-8d6e-8311462147aa","Type":"ContainerDied","Data":"cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b"} Nov 03 17:47:54.333653 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:54.333648 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg" Nov 03 17:47:54.333825 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:47:54.333687 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cde73ad2d3c2173b1750721a0038304358a8acd157256a270dcb0f7a435a184b" Nov 03 17:48:00.324503 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.324468 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l"] Nov 03 17:48:00.324907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.324872 4557 cpu_manager.go:414] "containerMap: removing container" podUID="77b6d628-3425-4976-8d6e-8311462147aa" containerName="revoke-keys" Nov 03 17:48:00.324907 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.324890 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77b6d628-3425-4976-8d6e-8311462147aa" containerName="revoke-keys" Nov 03 17:48:00.324974 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.324950 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="77b6d628-3425-4976-8d6e-8311462147aa" containerName="revoke-keys" Nov 03 17:48:00.328103 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.328087 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.335217 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.334940 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:48:00.336117 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.336091 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:48:00.336490 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.336450 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:48:00.336629 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.336451 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:48:00.339932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.339905 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l"] Nov 03 17:48:00.491434 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.491393 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.491633 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.491456 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bv9j\" (UniqueName: \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.491633 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.491563 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.592838 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.592747 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.592838 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.592831 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.593072 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.592872 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bv9j\" (UniqueName: \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.593531 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.593499 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.595254 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.595229 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.607757 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.607729 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bv9j\" (UniqueName: \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\") pod \"maas-api-revoke-sub-8d765196-5tp7l\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.642921 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.642890 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:00.919241 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:00.919211 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l"] Nov 03 17:48:00.920942 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:48:00.920910 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521f5b46_461a_4e5b_b8f7_68891d08c642.slice/crio-826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06 WatchSource:0}: Error finding container 826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06: Status 404 returned error can't find the container with id 826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06 Nov 03 17:48:01.420553 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:01.420519 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" event={"ID":"521f5b46-461a-4e5b-b8f7-68891d08c642","Type":"ContainerStarted","Data":"6afe45a531c75b0925df6e175fbe2f15ea2f7cfce6185c59eb0bd395e78274fa"} Nov 03 17:48:01.421037 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:01.420669 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" event={"ID":"521f5b46-461a-4e5b-b8f7-68891d08c642","Type":"ContainerStarted","Data":"826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06"} Nov 03 17:48:01.440646 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:01.440596 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" podStartSLOduration=1.440582753 podStartE2EDuration="1.440582753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:01.438991455 +0000 UTC m=+1113.276104304" watchObservedRunningTime="2026-11-03 17:48:01.440582753 +0000 UTC m=+1113.277695577" Nov 03 17:48:02.432354 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:02.432311 4557 generic.go:356] "Generic (PLEG): container finished" podID="521f5b46-461a-4e5b-b8f7-68891d08c642" containerID="6afe45a531c75b0925df6e175fbe2f15ea2f7cfce6185c59eb0bd395e78274fa" exitCode=0 Nov 03 17:48:02.432903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:02.432440 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" event={"ID":"521f5b46-461a-4e5b-b8f7-68891d08c642","Type":"ContainerDied","Data":"6afe45a531c75b0925df6e175fbe2f15ea2f7cfce6185c59eb0bd395e78274fa"} Nov 03 17:48:04.275784 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.275748 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:04.423594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.422955 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\") pod \"521f5b46-461a-4e5b-b8f7-68891d08c642\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " Nov 03 17:48:04.423594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.423061 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\") pod \"521f5b46-461a-4e5b-b8f7-68891d08c642\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " Nov 03 17:48:04.423594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.423173 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\" (UniqueName: \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\") pod \"521f5b46-461a-4e5b-b8f7-68891d08c642\" (UID: \"521f5b46-461a-4e5b-b8f7-68891d08c642\") " Nov 03 17:48:04.557896 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.477805 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca" pod "521f5b46-461a-4e5b-b8f7-68891d08c642" (UID: "521f5b46-461a-4e5b-b8f7-68891d08c642"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:48:04.557896 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.510728 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j" pod "521f5b46-461a-4e5b-b8f7-68891d08c642" (UID: "521f5b46-461a-4e5b-b8f7-68891d08c642"). InnerVolumeSpecName "kube-api-access-6bv9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:48:04.557896 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.525260 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:04.557896 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.525299 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bv9j\" (UniqueName: \"kubernetes.io/projected/521f5b46-461a-4e5b-b8f7-68891d08c642-kube-api-access-6bv9j\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:04.706282 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.705948 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca" pod "521f5b46-461a-4e5b-b8f7-68891d08c642" (UID: "521f5b46-461a-4e5b-b8f7-68891d08c642"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:48:04.711421 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.709459 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/521f5b46-461a-4e5b-b8f7-68891d08c642-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:04.781899 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.780435 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" event={"ID":"521f5b46-461a-4e5b-b8f7-68891d08c642","Type":"ContainerDied","Data":"826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06"} Nov 03 17:48:04.781899 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.780504 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="826d7131fa3eba0f711fa3c41f755d227625ae7397d21b5707f93fd4f9308c06" Nov 03 17:48:04.781899 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:04.780597 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l" Nov 03 17:48:10.522727 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.522649 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n"] Nov 03 17:48:10.523207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.523060 4557 cpu_manager.go:414] "containerMap: removing container" podUID="521f5b46-461a-4e5b-b8f7-68891d08c642" containerName="revoke-keys" Nov 03 17:48:10.523207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.523074 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="521f5b46-461a-4e5b-b8f7-68891d08c642" containerName="revoke-keys" Nov 03 17:48:10.523207 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.523173 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="521f5b46-461a-4e5b-b8f7-68891d08c642" containerName="revoke-keys" Nov 03 17:48:10.526373 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.526357 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.533676 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.533654 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:48:10.534054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.533883 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:48:10.534054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.533947 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:48:10.534054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.534026 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:48:10.537781 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.537755 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n"] Nov 03 17:48:10.667443 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.667401 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2zr\" (UniqueName: \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.667625 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.667454 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.667625 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.667531 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.769016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.768974 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.769228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.769045 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.769228 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.769199 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2zr\" (UniqueName: \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.769787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.769764 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.771939 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.771918 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.781745 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.781698 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2zr\" (UniqueName: \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\") pod \"maas-api-revoke-sub-b5efd0b9-kh26n\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:10.842710 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:10.842673 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:11.118773 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:11.118747 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n"] Nov 03 17:48:11.120514 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:48:11.120488 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04995b5_bb64_4892_8f1f_fff7c12250fe.slice/crio-0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a WatchSource:0}: Error finding container 0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a: Status 404 returned error can't find the container with id 0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a Nov 03 17:48:11.868666 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:11.868563 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" event={"ID":"a04995b5-bb64-4892-8f1f-fff7c12250fe","Type":"ContainerStarted","Data":"0cd35803f79ef9e1a70cf9676b75c99b6cb385e2d64b6c8b36c2e23873e0023a"} Nov 03 17:48:11.868666 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:11.868627 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" event={"ID":"a04995b5-bb64-4892-8f1f-fff7c12250fe","Type":"ContainerStarted","Data":"0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a"} Nov 03 17:48:11.889848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:11.889798 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" podStartSLOduration=1.889784536 podStartE2EDuration="1.889784536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:11.88665554 +0000 UTC m=+1123.723768365" watchObservedRunningTime="2026-11-03 17:48:11.889784536 +0000 UTC m=+1123.726897354" Nov 03 17:48:12.875668 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:12.875632 4557 generic.go:356] "Generic (PLEG): container finished" podID="a04995b5-bb64-4892-8f1f-fff7c12250fe" containerID="0cd35803f79ef9e1a70cf9676b75c99b6cb385e2d64b6c8b36c2e23873e0023a" exitCode=0 Nov 03 17:48:12.876069 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:12.875714 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" event={"ID":"a04995b5-bb64-4892-8f1f-fff7c12250fe","Type":"ContainerDied","Data":"0cd35803f79ef9e1a70cf9676b75c99b6cb385e2d64b6c8b36c2e23873e0023a"} Nov 03 17:48:14.020453 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.020429 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:14.103876 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.103844 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\") pod \"a04995b5-bb64-4892-8f1f-fff7c12250fe\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " Nov 03 17:48:14.104065 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.103971 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\") pod \"a04995b5-bb64-4892-8f1f-fff7c12250fe\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " Nov 03 17:48:14.104065 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.104039 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\" (UniqueName: \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\") pod \"a04995b5-bb64-4892-8f1f-fff7c12250fe\" (UID: \"a04995b5-bb64-4892-8f1f-fff7c12250fe\") " Nov 03 17:48:14.104191 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.104172 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca" pod "a04995b5-bb64-4892-8f1f-fff7c12250fe" (UID: "a04995b5-bb64-4892-8f1f-fff7c12250fe"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:48:14.104370 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.104352 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:14.105941 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.105920 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca" pod "a04995b5-bb64-4892-8f1f-fff7c12250fe" (UID: "a04995b5-bb64-4892-8f1f-fff7c12250fe"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:48:14.106046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.106018 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr" pod "a04995b5-bb64-4892-8f1f-fff7c12250fe" (UID: "a04995b5-bb64-4892-8f1f-fff7c12250fe"). InnerVolumeSpecName "kube-api-access-4q2zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:48:14.205835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.205802 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q2zr\" (UniqueName: \"kubernetes.io/projected/a04995b5-bb64-4892-8f1f-fff7c12250fe-kube-api-access-4q2zr\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:14.205835 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.205831 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a04995b5-bb64-4892-8f1f-fff7c12250fe-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:14.888393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.888353 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" event={"ID":"a04995b5-bb64-4892-8f1f-fff7c12250fe","Type":"ContainerDied","Data":"0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a"} Nov 03 17:48:14.888393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.888378 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n" Nov 03 17:48:14.888640 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:14.888414 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0770d1a1d5db9d93c4cf56793516361678a3c945b66d8696672f04bc971c292a" Nov 03 17:48:19.414550 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:48:19.414510 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:48:20.757750 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.757712 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx"] Nov 03 17:48:20.758132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.758124 4557 cpu_manager.go:414] "containerMap: removing container" podUID="a04995b5-bb64-4892-8f1f-fff7c12250fe" containerName="revoke-keys" Nov 03 17:48:20.758174 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.758134 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a04995b5-bb64-4892-8f1f-fff7c12250fe" containerName="revoke-keys" Nov 03 17:48:20.758208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.758198 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="a04995b5-bb64-4892-8f1f-fff7c12250fe" containerName="revoke-keys" Nov 03 17:48:20.760891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.760867 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.765918 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.765894 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:48:20.768227 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.768205 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:48:20.769652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.769632 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:48:20.769783 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.769662 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:48:20.772500 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.772471 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx"] Nov 03 17:48:20.874650 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.874609 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.874862 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.874666 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.874862 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.874804 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbt9s\" (UniqueName: \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.975967 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.975930 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.976182 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.975977 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.976182 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.976021 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbt9s\" (UniqueName: \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.976761 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.976739 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.978433 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.978405 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:20.988668 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:20.988647 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbt9s\" (UniqueName: \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\") pod \"maas-api-revoke-sub-0140d12c-26txx\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:21.074946 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:21.074860 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:21.352301 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:48:21.352268 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22db20d_d6e6_4bfd_b8d2_fffec2757f50.slice/crio-5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4 WatchSource:0}: Error finding container 5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4: Status 404 returned error can't find the container with id 5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4 Nov 03 17:48:21.352546 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:21.352523 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx"] Nov 03 17:48:21.925464 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:21.925431 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" event={"ID":"d22db20d-d6e6-4bfd-b8d2-fffec2757f50","Type":"ContainerStarted","Data":"5113de4ffd9a55b19128b2120dabe82888a3bab124ea6dc6d39e407dfbe551cb"} Nov 03 17:48:21.925878 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:21.925484 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" event={"ID":"d22db20d-d6e6-4bfd-b8d2-fffec2757f50","Type":"ContainerStarted","Data":"5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4"} Nov 03 17:48:21.946140 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:21.946090 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" podStartSLOduration=1.946074865 podStartE2EDuration="1.946074865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:21.945262724 +0000 UTC m=+1133.782375551" watchObservedRunningTime="2026-11-03 17:48:21.946074865 +0000 UTC m=+1133.783187689" Nov 03 17:48:22.938659 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:22.938614 4557 generic.go:356] "Generic (PLEG): container finished" podID="d22db20d-d6e6-4bfd-b8d2-fffec2757f50" containerID="5113de4ffd9a55b19128b2120dabe82888a3bab124ea6dc6d39e407dfbe551cb" exitCode=0 Nov 03 17:48:22.939180 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:22.938710 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" event={"ID":"d22db20d-d6e6-4bfd-b8d2-fffec2757f50","Type":"ContainerDied","Data":"5113de4ffd9a55b19128b2120dabe82888a3bab124ea6dc6d39e407dfbe551cb"} Nov 03 17:48:24.708592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:24.699876 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:24.937140 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:24.937065 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\" (UniqueName: \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\") pod \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " Nov 03 17:48:24.941890 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:24.941840 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\") pod \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " Nov 03 17:48:24.953320 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:24.953274 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\") pod \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\" (UID: \"d22db20d-d6e6-4bfd-b8d2-fffec2757f50\") " Nov 03 17:48:24.969897 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:24.969824 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca" pod "d22db20d-d6e6-4bfd-b8d2-fffec2757f50" (UID: "d22db20d-d6e6-4bfd-b8d2-fffec2757f50"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:48:25.051495 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.051436 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s" pod "d22db20d-d6e6-4bfd-b8d2-fffec2757f50" (UID: "d22db20d-d6e6-4bfd-b8d2-fffec2757f50"). InnerVolumeSpecName "kube-api-access-qbt9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:48:25.063593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.060708 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca" pod "d22db20d-d6e6-4bfd-b8d2-fffec2757f50" (UID: "d22db20d-d6e6-4bfd-b8d2-fffec2757f50"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:48:25.063593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.061400 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:25.063593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.061430 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:25.063593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.061450 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbt9s\" (UniqueName: \"kubernetes.io/projected/d22db20d-d6e6-4bfd-b8d2-fffec2757f50-kube-api-access-qbt9s\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:25.193669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.190281 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" event={"ID":"d22db20d-d6e6-4bfd-b8d2-fffec2757f50","Type":"ContainerDied","Data":"5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4"} Nov 03 17:48:25.193669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.190343 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5681c8d3ad2fc2f950ea860eb8266f3946c49f45c7c36c6860bd7cb5bb8290d4" Nov 03 17:48:25.193669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:25.190413 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx" Nov 03 17:48:31.007084 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.007045 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv"] Nov 03 17:48:31.007486 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.007457 4557 cpu_manager.go:414] "containerMap: removing container" podUID="d22db20d-d6e6-4bfd-b8d2-fffec2757f50" containerName="revoke-keys" Nov 03 17:48:31.007486 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.007468 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d22db20d-d6e6-4bfd-b8d2-fffec2757f50" containerName="revoke-keys" Nov 03 17:48:31.007590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.007533 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="d22db20d-d6e6-4bfd-b8d2-fffec2757f50" containerName="revoke-keys" Nov 03 17:48:31.011786 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.011770 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.019047 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.018751 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:48:31.019047 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.018888 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:48:31.019047 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.019006 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:48:31.019220 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.019085 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:48:31.021715 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.021690 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv"] Nov 03 17:48:31.053553 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.053518 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.053734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.053585 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7l9t\" (UniqueName: \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.053734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.053691 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.154995 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.154953 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.155172 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.155008 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7l9t\" (UniqueName: \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.155172 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.155036 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.155763 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.155744 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.157400 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.157376 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.168415 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.168381 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7l9t\" (UniqueName: \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\") pod \"maas-api-revoke-sub-bae3e5f0-w67kv\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.326366 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.326290 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:31.610233 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:31.610198 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv"] Nov 03 17:48:31.611483 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:48:31.611457 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3985ec73_7b35_4247_aace_b50a5e7c8e11.slice/crio-d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f WatchSource:0}: Error finding container d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f: Status 404 returned error can't find the container with id d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f Nov 03 17:48:32.230831 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:32.230745 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" event={"ID":"3985ec73-7b35-4247-aace-b50a5e7c8e11","Type":"ContainerStarted","Data":"8ee4e54ba00d082a1e7ec5478af2793634785985fc3525d69f75aa90e6cd1c02"} Nov 03 17:48:32.230831 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:32.230808 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" event={"ID":"3985ec73-7b35-4247-aace-b50a5e7c8e11","Type":"ContainerStarted","Data":"d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f"} Nov 03 17:48:32.251758 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:32.251706 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" podStartSLOduration=2.251688655 podStartE2EDuration="2.251688655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:32.249394621 +0000 UTC m=+1144.086507445" watchObservedRunningTime="2026-11-03 17:48:32.251688655 +0000 UTC m=+1144.088801480" Nov 03 17:48:33.242162 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:33.242120 4557 generic.go:356] "Generic (PLEG): container finished" podID="3985ec73-7b35-4247-aace-b50a5e7c8e11" containerID="8ee4e54ba00d082a1e7ec5478af2793634785985fc3525d69f75aa90e6cd1c02" exitCode=0 Nov 03 17:48:33.242739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:33.242214 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" event={"ID":"3985ec73-7b35-4247-aace-b50a5e7c8e11","Type":"ContainerDied","Data":"8ee4e54ba00d082a1e7ec5478af2793634785985fc3525d69f75aa90e6cd1c02"} Nov 03 17:48:35.189975 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.189942 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:35.483800 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.483761 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" event={"ID":"3985ec73-7b35-4247-aace-b50a5e7c8e11","Type":"ContainerDied","Data":"d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f"} Nov 03 17:48:35.484047 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.484028 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d43f15583ff20b37e1fc9b04bc14a08d6d5fd4c1c293271edd287c5898917a5f" Nov 03 17:48:35.484247 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.484232 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv" Nov 03 17:48:35.502602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.490147 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\") pod \"3985ec73-7b35-4247-aace-b50a5e7c8e11\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " Nov 03 17:48:35.502602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.490214 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\") pod \"3985ec73-7b35-4247-aace-b50a5e7c8e11\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " Nov 03 17:48:35.502602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.490250 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\" (UniqueName: \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\") pod \"3985ec73-7b35-4247-aace-b50a5e7c8e11\" (UID: \"3985ec73-7b35-4247-aace-b50a5e7c8e11\") " Nov 03 17:48:35.502602 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.491537 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca" pod "3985ec73-7b35-4247-aace-b50a5e7c8e11" (UID: "3985ec73-7b35-4247-aace-b50a5e7c8e11"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:48:35.512414 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.512382 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t" pod "3985ec73-7b35-4247-aace-b50a5e7c8e11" (UID: "3985ec73-7b35-4247-aace-b50a5e7c8e11"). InnerVolumeSpecName "kube-api-access-x7l9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:48:35.513617 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.513023 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca" pod "3985ec73-7b35-4247-aace-b50a5e7c8e11" (UID: "3985ec73-7b35-4247-aace-b50a5e7c8e11"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:48:35.594589 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.594247 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:35.594589 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.594291 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3985ec73-7b35-4247-aace-b50a5e7c8e11-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:35.594589 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.594310 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7l9t\" (UniqueName: \"kubernetes.io/projected/3985ec73-7b35-4247-aace-b50a5e7c8e11-kube-api-access-x7l9t\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:48:35.746798 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.746695 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:48:35.747093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:35.747057 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:48:49.512594 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:48:49.511360 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:48:51.257278 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.257240 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:48:51.257679 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.257665 4557 cpu_manager.go:414] "containerMap: removing container" podUID="3985ec73-7b35-4247-aace-b50a5e7c8e11" containerName="revoke-keys" Nov 03 17:48:51.257728 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.257680 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3985ec73-7b35-4247-aace-b50a5e7c8e11" containerName="revoke-keys" Nov 03 17:48:51.257771 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.257762 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="3985ec73-7b35-4247-aace-b50a5e7c8e11" containerName="revoke-keys" Nov 03 17:48:51.260789 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.260768 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.273332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.273308 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-67776cc3-unmatched-kserve-self-signed-certs\"" Nov 03 17:48:51.286284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.286246 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.347243 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.347322 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.347756 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.347893 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.347977 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.357590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.348030 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6kz\" (UniqueName: \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.449095 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.449054 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.450195 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.450124 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.450434 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.450403 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.450638 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.450621 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.450857 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.450840 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.451030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.451013 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6kz\" (UniqueName: \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.453193 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.453134 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.453862 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.453830 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.454272 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.454255 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.489294 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.488212 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.491476 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.491411 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.528548 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.528464 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6kz\" (UniqueName: \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\") pod \"grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.572049 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.572010 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:48:51.862393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:51.862363 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:48:51.863726 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:48:51.863696 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e8d154a_2e6a_470d_ab4f_45493e621d4d.slice/crio-2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05 WatchSource:0}: Error finding container 2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05: Status 404 returned error can't find the container with id 2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05 Nov 03 17:48:52.693556 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:52.693501 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" event={"ID":"8e8d154a-2e6a-470d-ab4f-45493e621d4d","Type":"ContainerStarted","Data":"4934df943f44f12567d3849b63904a967b6a4390adaca1c807db3d3b3d0b1eb3"} Nov 03 17:48:52.694102 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:52.693561 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" event={"ID":"8e8d154a-2e6a-470d-ab4f-45493e621d4d","Type":"ContainerStarted","Data":"2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05"} Nov 03 17:48:52.716654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:52.716591 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" podStartSLOduration=1.716555802 podStartE2EDuration="1.716555802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:52.713784632 +0000 UTC m=+1164.550897464" watchObservedRunningTime="2026-11-03 17:48:52.716555802 +0000 UTC m=+1164.553668628" Nov 03 17:48:53.576915 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:48:53.576859 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:49:01.572433 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:01.572392 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:49:01.585273 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:01.585248 4557 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:49:01.879200 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:01.879120 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:49:19.415319 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:49:19.415277 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:49:26.040854 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:26.040820 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z"] Nov 03 17:49:26.043551 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:26.043532 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-57f5f62d-rg72z"] Nov 03 17:49:26.323189 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:26.323111 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecc8d139-ad50-46be-a7d0-56cf9c797977" path="/var/lib/kubelet/pods/ecc8d139-ad50-46be-a7d0-56cf9c797977/volumes" Nov 03 17:49:28.468498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:28.468471 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:49:28.471676 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:28.471656 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:49:33.025685 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.025630 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh"] Nov 03 17:49:33.028076 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.028052 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d802791d-9v9dh"] Nov 03 17:49:33.945019 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.944980 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4"] Nov 03 17:49:33.949275 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.949249 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:33.956757 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.956718 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:49:33.956927 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.956850 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:49:33.957307 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.956947 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:49:33.957307 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.956993 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:49:33.958904 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:33.958866 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4"] Nov 03 17:49:34.003534 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.003493 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccnph\" (UniqueName: \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.003733 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.003547 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.003733 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.003651 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.104596 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.104537 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccnph\" (UniqueName: \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.104991 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.104599 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.104991 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.104639 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.105327 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.105307 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.106886 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.106868 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.117528 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.117495 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccnph\" (UniqueName: \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\") pod \"maas-api-revoke-sub-04f3ada8-vjwg4\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.263854 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.263767 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:34.326868 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.326838 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da4550e8-06c2-44b4-9887-bcfd35c93b1b" path="/var/lib/kubelet/pods/da4550e8-06c2-44b4-9887-bcfd35c93b1b/volumes" Nov 03 17:49:34.538509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:34.538477 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4"] Nov 03 17:49:34.539383 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:49:34.539351 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8050acb4_12f7_4226_8689_3a46c4cc3ad0.slice/crio-75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a WatchSource:0}: Error finding container 75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a: Status 404 returned error can't find the container with id 75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a Nov 03 17:49:35.045072 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:35.045034 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" event={"ID":"8050acb4-12f7-4226-8689-3a46c4cc3ad0","Type":"ContainerStarted","Data":"e5777675d4f941b93af8d0e3823dbc0ac3a2bc5f3a8ab58609d80a3fe1ea4305"} Nov 03 17:49:35.045275 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:35.045114 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" event={"ID":"8050acb4-12f7-4226-8689-3a46c4cc3ad0","Type":"ContainerStarted","Data":"75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a"} Nov 03 17:49:35.064197 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:35.064119 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" podStartSLOduration=2.06410628 podStartE2EDuration="2.06410628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:49:35.063272455 +0000 UTC m=+1206.900385279" watchObservedRunningTime="2026-11-03 17:49:35.06410628 +0000 UTC m=+1206.901219103" Nov 03 17:49:36.051985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:36.051950 4557 generic.go:356] "Generic (PLEG): container finished" podID="8050acb4-12f7-4226-8689-3a46c4cc3ad0" containerID="e5777675d4f941b93af8d0e3823dbc0ac3a2bc5f3a8ab58609d80a3fe1ea4305" exitCode=0 Nov 03 17:49:36.052368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:36.052018 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" event={"ID":"8050acb4-12f7-4226-8689-3a46c4cc3ad0","Type":"ContainerDied","Data":"e5777675d4f941b93af8d0e3823dbc0ac3a2bc5f3a8ab58609d80a3fe1ea4305"} Nov 03 17:49:37.193107 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.193082 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:37.338447 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.338362 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\") pod \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " Nov 03 17:49:37.338628 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.338487 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\") pod \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " Nov 03 17:49:37.338628 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.338532 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\" (UniqueName: \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\") pod \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\" (UID: \"8050acb4-12f7-4226-8689-3a46c4cc3ad0\") " Nov 03 17:49:37.338887 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.338862 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca" pod "8050acb4-12f7-4226-8689-3a46c4cc3ad0" (UID: "8050acb4-12f7-4226-8689-3a46c4cc3ad0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:49:37.340846 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.340816 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca" pod "8050acb4-12f7-4226-8689-3a46c4cc3ad0" (UID: "8050acb4-12f7-4226-8689-3a46c4cc3ad0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:49:37.340975 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.340819 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph" pod "8050acb4-12f7-4226-8689-3a46c4cc3ad0" (UID: "8050acb4-12f7-4226-8689-3a46c4cc3ad0"). InnerVolumeSpecName "kube-api-access-ccnph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:49:37.439741 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.439709 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:37.439741 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.439739 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8050acb4-12f7-4226-8689-3a46c4cc3ad0-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:37.439955 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:37.439750 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccnph\" (UniqueName: \"kubernetes.io/projected/8050acb4-12f7-4226-8689-3a46c4cc3ad0-kube-api-access-ccnph\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:38.063102 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:38.063073 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" Nov 03 17:49:38.063256 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:38.063111 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4" event={"ID":"8050acb4-12f7-4226-8689-3a46c4cc3ad0","Type":"ContainerDied","Data":"75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a"} Nov 03 17:49:38.063256 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:38.063158 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75112575443b0bdcc9778037f61340d26e69a7e49d5d913b907295244708a12a" Nov 03 17:49:43.027678 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:43.027400 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9"] Nov 03 17:49:43.030211 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:43.030184 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e27c27a8-b52f9"] Nov 03 17:49:44.284327 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.284288 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs"] Nov 03 17:49:44.285472 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.285443 4557 cpu_manager.go:414] "containerMap: removing container" podUID="8050acb4-12f7-4226-8689-3a46c4cc3ad0" containerName="revoke-keys" Nov 03 17:49:44.285663 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.285645 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8050acb4-12f7-4226-8689-3a46c4cc3ad0" containerName="revoke-keys" Nov 03 17:49:44.285966 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.285949 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="8050acb4-12f7-4226-8689-3a46c4cc3ad0" containerName="revoke-keys" Nov 03 17:49:44.290045 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.290009 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.297709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.297129 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:49:44.297709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.297241 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:49:44.297709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.297286 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:49:44.297709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.297338 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:49:44.300352 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.300321 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs"] Nov 03 17:49:44.322829 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.322794 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3645d355-e742-411a-bcf4-a4b36860cb0d" path="/var/lib/kubelet/pods/3645d355-e742-411a-bcf4-a4b36860cb0d/volumes" Nov 03 17:49:44.412793 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.412764 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.412985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.412939 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlngc\" (UniqueName: \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.413051 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.412981 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.514144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.514107 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlngc\" (UniqueName: \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.514144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.514148 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.514359 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.514186 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.514967 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.514943 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.516541 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.516512 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.527236 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.527209 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlngc\" (UniqueName: \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\") pod \"maas-api-revoke-sub-58d7dc92-72brs\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.608738 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.608663 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:44.890850 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:44.890821 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs"] Nov 03 17:49:44.892089 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:49:44.892059 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4086381_23dc_4b59_a341_4e8ca07ae82a.slice/crio-da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583 WatchSource:0}: Error finding container da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583: Status 404 returned error can't find the container with id da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583 Nov 03 17:49:45.103335 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:45.103301 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" event={"ID":"d4086381-23dc-4b59-a341-4e8ca07ae82a","Type":"ContainerStarted","Data":"da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583"} Nov 03 17:49:46.110460 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:46.110370 4557 generic.go:356] "Generic (PLEG): container finished" podID="d4086381-23dc-4b59-a341-4e8ca07ae82a" containerID="13c22d576779101eae7ad8e4713eaf6b4213bc71156d920caf65121bc3db356f" exitCode=0 Nov 03 17:49:46.110921 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:46.110450 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" event={"ID":"d4086381-23dc-4b59-a341-4e8ca07ae82a","Type":"ContainerDied","Data":"13c22d576779101eae7ad8e4713eaf6b4213bc71156d920caf65121bc3db356f"} Nov 03 17:49:47.337267 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.336949 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:47.453194 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.453118 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\") pod \"d4086381-23dc-4b59-a341-4e8ca07ae82a\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " Nov 03 17:49:47.453669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.453624 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\") pod \"d4086381-23dc-4b59-a341-4e8ca07ae82a\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " Nov 03 17:49:47.454236 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.454042 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\" (UniqueName: \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\") pod \"d4086381-23dc-4b59-a341-4e8ca07ae82a\" (UID: \"d4086381-23dc-4b59-a341-4e8ca07ae82a\") " Nov 03 17:49:47.455194 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.455157 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca" pod "d4086381-23dc-4b59-a341-4e8ca07ae82a" (UID: "d4086381-23dc-4b59-a341-4e8ca07ae82a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:49:47.455481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.455453 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:47.456799 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.456771 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca" pod "d4086381-23dc-4b59-a341-4e8ca07ae82a" (UID: "d4086381-23dc-4b59-a341-4e8ca07ae82a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:49:47.457118 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.457079 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc" pod "d4086381-23dc-4b59-a341-4e8ca07ae82a" (UID: "d4086381-23dc-4b59-a341-4e8ca07ae82a"). InnerVolumeSpecName "kube-api-access-hlngc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:49:47.556836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.556793 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4086381-23dc-4b59-a341-4e8ca07ae82a-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:47.556836 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:47.556837 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlngc\" (UniqueName: \"kubernetes.io/projected/d4086381-23dc-4b59-a341-4e8ca07ae82a-kube-api-access-hlngc\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:48.140112 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:48.140071 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" event={"ID":"d4086381-23dc-4b59-a341-4e8ca07ae82a","Type":"ContainerDied","Data":"da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583"} Nov 03 17:49:48.140405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:48.140386 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da721f2f965406c18452897ab3e3363d49a8b204bc7e5a99f04d3df4810b6583" Nov 03 17:49:48.140605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:48.140588 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs" Nov 03 17:49:49.543591 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:49:49.533338 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:49:54.052664 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.052622 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7"] Nov 03 17:49:54.057590 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.055434 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-abf6130d-djtc7"] Nov 03 17:49:54.353649 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.350656 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ae284b8-f0c9-48ba-bd61-94d2469d30c6" path="/var/lib/kubelet/pods/1ae284b8-f0c9-48ba-bd61-94d2469d30c6/volumes" Nov 03 17:49:54.537587 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.536626 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d"] Nov 03 17:49:54.537587 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.537322 4557 cpu_manager.go:414] "containerMap: removing container" podUID="d4086381-23dc-4b59-a341-4e8ca07ae82a" containerName="revoke-keys" Nov 03 17:49:54.537587 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.537344 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4086381-23dc-4b59-a341-4e8ca07ae82a" containerName="revoke-keys" Nov 03 17:49:54.537587 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.537461 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4086381-23dc-4b59-a341-4e8ca07ae82a" containerName="revoke-keys" Nov 03 17:49:54.545681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.541737 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.545681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.541770 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d"] Nov 03 17:49:54.554024 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.553997 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:49:54.554315 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.554295 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:49:54.558466 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.558447 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:49:54.558662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.558647 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:49:54.604241 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.604143 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.625725 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.625692 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.633847 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.633812 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rdv\" (UniqueName: \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.741605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.741185 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.741605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.741255 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.741605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.741321 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rdv\" (UniqueName: \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.758592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.742939 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.774589 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.765343 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rdv\" (UniqueName: \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.774838 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.771953 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d624daf5-rmx7d\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:54.945401 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:54.945351 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:55.299187 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:55.299152 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d"] Nov 03 17:49:55.300374 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:49:55.300347 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e5819c_0ec5_456e_8ba5_bec5fb783859.slice/crio-29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f WatchSource:0}: Error finding container 29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f: Status 404 returned error can't find the container with id 29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f Nov 03 17:49:56.298922 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:56.298887 4557 generic.go:356] "Generic (PLEG): container finished" podID="18e5819c-0ec5-456e-8ba5-bec5fb783859" containerID="5dd5de18ac6ab3b6f74d28688ef01c1c6f60d7f910873131792e5271e8753d58" exitCode=0 Nov 03 17:49:56.299072 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:56.298970 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" event={"ID":"18e5819c-0ec5-456e-8ba5-bec5fb783859","Type":"ContainerDied","Data":"5dd5de18ac6ab3b6f74d28688ef01c1c6f60d7f910873131792e5271e8753d58"} Nov 03 17:49:56.299072 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:56.299021 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" event={"ID":"18e5819c-0ec5-456e-8ba5-bec5fb783859","Type":"ContainerStarted","Data":"29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f"} Nov 03 17:49:57.440815 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.440791 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:57.572053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.571958 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\" (UniqueName: \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\") pod \"18e5819c-0ec5-456e-8ba5-bec5fb783859\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " Nov 03 17:49:57.572053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.572004 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\") pod \"18e5819c-0ec5-456e-8ba5-bec5fb783859\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " Nov 03 17:49:57.572053 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.572025 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\") pod \"18e5819c-0ec5-456e-8ba5-bec5fb783859\" (UID: \"18e5819c-0ec5-456e-8ba5-bec5fb783859\") " Nov 03 17:49:57.572427 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.572400 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca" pod "18e5819c-0ec5-456e-8ba5-bec5fb783859" (UID: "18e5819c-0ec5-456e-8ba5-bec5fb783859"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:49:57.574216 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.574186 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca" pod "18e5819c-0ec5-456e-8ba5-bec5fb783859" (UID: "18e5819c-0ec5-456e-8ba5-bec5fb783859"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:49:57.574216 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.574191 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv" pod "18e5819c-0ec5-456e-8ba5-bec5fb783859" (UID: "18e5819c-0ec5-456e-8ba5-bec5fb783859"). InnerVolumeSpecName "kube-api-access-p5rdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:49:57.673355 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.673317 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5rdv\" (UniqueName: \"kubernetes.io/projected/18e5819c-0ec5-456e-8ba5-bec5fb783859-kube-api-access-p5rdv\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:57.673355 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.673350 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:57.673355 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:57.673361 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/18e5819c-0ec5-456e-8ba5-bec5fb783859-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:49:58.310746 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:58.310714 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" Nov 03 17:49:58.310940 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:58.310753 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d" event={"ID":"18e5819c-0ec5-456e-8ba5-bec5fb783859","Type":"ContainerDied","Data":"29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f"} Nov 03 17:49:58.310940 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:49:58.310825 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29f962a4c8ddff93445993911bdc7d8986c570f8031864f27ef5d848ead6c70f" Nov 03 17:50:04.737664 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.737627 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb"] Nov 03 17:50:04.738163 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.738009 4557 cpu_manager.go:414] "containerMap: removing container" podUID="18e5819c-0ec5-456e-8ba5-bec5fb783859" containerName="revoke-keys" Nov 03 17:50:04.738163 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.738020 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18e5819c-0ec5-456e-8ba5-bec5fb783859" containerName="revoke-keys" Nov 03 17:50:04.738163 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.738103 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="18e5819c-0ec5-456e-8ba5-bec5fb783859" containerName="revoke-keys" Nov 03 17:50:04.740979 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.740961 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.747274 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.747248 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:50:04.748894 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.748641 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:50:04.748894 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.748682 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:50:04.748894 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.748748 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:50:04.753042 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.753020 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb"] Nov 03 17:50:04.851232 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.851194 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.851409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.851312 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.851456 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.851415 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65l9g\" (UniqueName: \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.953059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.953010 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65l9g\" (UniqueName: \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.953262 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.953067 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.953262 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.953149 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.953893 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.953871 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.955533 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.955511 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:04.965551 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:04.965522 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65l9g\" (UniqueName: \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\") pod \"maas-api-revoke-sub-246d6b80-knpwb\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:05.055972 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:05.055878 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:05.344873 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:05.344847 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb"] Nov 03 17:50:05.346293 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:50:05.346263 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7dda2b_5069_4243_8ce3_cd5b25d779ec.slice/crio-3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636 WatchSource:0}: Error finding container 3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636: Status 404 returned error can't find the container with id 3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636 Nov 03 17:50:05.356634 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:05.356608 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" event={"ID":"0e7dda2b-5069-4243-8ce3-cd5b25d779ec","Type":"ContainerStarted","Data":"3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636"} Nov 03 17:50:06.365073 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:06.365040 4557 generic.go:356] "Generic (PLEG): container finished" podID="0e7dda2b-5069-4243-8ce3-cd5b25d779ec" containerID="6942b26b75358831db842e1d8e7b89f29078b43c72d66e673ae3db6e3d241912" exitCode=0 Nov 03 17:50:06.365465 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:06.365116 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" event={"ID":"0e7dda2b-5069-4243-8ce3-cd5b25d779ec","Type":"ContainerDied","Data":"6942b26b75358831db842e1d8e7b89f29078b43c72d66e673ae3db6e3d241912"} Nov 03 17:50:07.687826 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.687790 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:07.799593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.797185 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\") pod \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " Nov 03 17:50:07.799593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.797262 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\" (UniqueName: \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\") pod \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " Nov 03 17:50:07.799593 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.797365 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\") pod \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\" (UID: \"0e7dda2b-5069-4243-8ce3-cd5b25d779ec\") " Nov 03 17:50:07.814062 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.814015 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca" pod "0e7dda2b-5069-4243-8ce3-cd5b25d779ec" (UID: "0e7dda2b-5069-4243-8ce3-cd5b25d779ec"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:50:07.817059 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.817017 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g" pod "0e7dda2b-5069-4243-8ce3-cd5b25d779ec" (UID: "0e7dda2b-5069-4243-8ce3-cd5b25d779ec"). InnerVolumeSpecName "kube-api-access-65l9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:50:07.900672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.899715 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca" pod "0e7dda2b-5069-4243-8ce3-cd5b25d779ec" (UID: "0e7dda2b-5069-4243-8ce3-cd5b25d779ec"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:50:07.900672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.900400 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65l9g\" (UniqueName: \"kubernetes.io/projected/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-kube-api-access-65l9g\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:07.900672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.900430 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:07.900672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:07.900446 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0e7dda2b-5069-4243-8ce3-cd5b25d779ec-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:08.489725 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:08.489674 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" Nov 03 17:50:08.508858 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:08.508816 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb" event={"ID":"0e7dda2b-5069-4243-8ce3-cd5b25d779ec","Type":"ContainerDied","Data":"3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636"} Nov 03 17:50:08.509155 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:08.509138 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e90cd8431c27758c1ced6f5d3982dc36e9017992ed5cde42fa5f1cd0a05f636" Nov 03 17:50:14.979129 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.979089 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb"] Nov 03 17:50:14.979517 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.979491 4557 cpu_manager.go:414] "containerMap: removing container" podUID="0e7dda2b-5069-4243-8ce3-cd5b25d779ec" containerName="revoke-keys" Nov 03 17:50:14.979517 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.979502 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e7dda2b-5069-4243-8ce3-cd5b25d779ec" containerName="revoke-keys" Nov 03 17:50:14.979606 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.979596 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e7dda2b-5069-4243-8ce3-cd5b25d779ec" containerName="revoke-keys" Nov 03 17:50:14.983492 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.983470 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:14.990162 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.990133 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 17:50:14.990366 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.990216 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 17:50:14.990436 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.990420 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gmjkz\"" Nov 03 17:50:14.990498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.990463 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 17:50:14.992559 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:14.992533 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb"] Nov 03 17:50:15.008685 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.008649 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvxp\" (UniqueName: \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.008818 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.008693 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.008868 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.008848 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.110263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.110224 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snvxp\" (UniqueName: \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.110263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.110263 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.110485 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.110303 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.110985 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.110956 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.112662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.112639 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.122766 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.122739 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvxp\" (UniqueName: \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\") pod \"maas-api-revoke-sub-2b56a21f-5nzrb\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.297815 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.297724 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:15.574823 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:15.574791 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb"] Nov 03 17:50:15.576124 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:50:15.576095 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc29dec6_f288_422d_82bd_d13b9be0a424.slice/crio-0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7 WatchSource:0}: Error finding container 0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7: Status 404 returned error can't find the container with id 0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7 Nov 03 17:50:16.559459 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:16.559419 4557 generic.go:356] "Generic (PLEG): container finished" podID="fc29dec6-f288-422d-82bd-d13b9be0a424" containerID="b326acddd7f8eac067829d814001a46a9479d9d6a403e5563407ce3f45509746" exitCode=0 Nov 03 17:50:16.559864 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:16.559513 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" event={"ID":"fc29dec6-f288-422d-82bd-d13b9be0a424","Type":"ContainerDied","Data":"b326acddd7f8eac067829d814001a46a9479d9d6a403e5563407ce3f45509746"} Nov 03 17:50:16.559864 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:16.559595 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" event={"ID":"fc29dec6-f288-422d-82bd-d13b9be0a424","Type":"ContainerStarted","Data":"0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7"} Nov 03 17:50:17.772213 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.772175 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:17.844959 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.844841 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\") pod \"fc29dec6-f288-422d-82bd-d13b9be0a424\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " Nov 03 17:50:17.844959 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.844937 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\" (UniqueName: \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\") pod \"fc29dec6-f288-422d-82bd-d13b9be0a424\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " Nov 03 17:50:17.845209 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.845022 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\") pod \"fc29dec6-f288-422d-82bd-d13b9be0a424\" (UID: \"fc29dec6-f288-422d-82bd-d13b9be0a424\") " Nov 03 17:50:17.845723 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.845691 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca" pod "fc29dec6-f288-422d-82bd-d13b9be0a424" (UID: "fc29dec6-f288-422d-82bd-d13b9be0a424"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:50:17.864604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.848118 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca" pod "fc29dec6-f288-422d-82bd-d13b9be0a424" (UID: "fc29dec6-f288-422d-82bd-d13b9be0a424"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:50:17.864604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.856124 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp" pod "fc29dec6-f288-422d-82bd-d13b9be0a424" (UID: "fc29dec6-f288-422d-82bd-d13b9be0a424"). InnerVolumeSpecName "kube-api-access-snvxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:50:17.957605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.952251 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-xks-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:17.957605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.952300 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snvxp\" (UniqueName: \"kubernetes.io/projected/fc29dec6-f288-422d-82bd-d13b9be0a424-kube-api-access-snvxp\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:17.957605 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:17.952317 4557 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fc29dec6-f288-422d-82bd-d13b9be0a424-maas-api-openshift-ca\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:18.624970 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:18.624928 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" event={"ID":"fc29dec6-f288-422d-82bd-d13b9be0a424","Type":"ContainerDied","Data":"0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7"} Nov 03 17:50:18.625235 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:18.625215 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a9790f1162e4beadbcfddc251440e22939a85bf79634205a5d8b26a3e8109e7" Nov 03 17:50:18.625413 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:18.625399 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb" Nov 03 17:50:19.532610 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:50:19.529962 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:50:28.727540 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:28.727502 4557 scope.go:122] "RemoveContainer" containerID="689a7128dbe619b12804380480f84208dcbae808907460e15b9a8c0b937ca012" Nov 03 17:50:30.480592 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:30.455400 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:50:32.933301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:32.932765 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-pdhst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:50:32.933301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:32.932850 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:50:33.006301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:33.005792 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-wh8tk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:50:33.006301 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:33.005863 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:50:33.508764 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:33.508722 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-j5vsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:50:33.509105 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:33.509056 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:50:35.724591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:35.723696 4557 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-58ghk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 17:50:35.724591 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:35.723805 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 17:50:45.620205 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.620140 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerName="main" containerID="cri-o://4934df943f44f12567d3849b63904a967b6a4390adaca1c807db3d3b3d0b1eb3" gracePeriod=45 Nov 03 17:50:45.864455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.864421 4557 generic.go:356] "Generic (PLEG): container finished" podID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerID="4934df943f44f12567d3849b63904a967b6a4390adaca1c807db3d3b3d0b1eb3" exitCode=0 Nov 03 17:50:45.864561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.864498 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" event={"ID":"8e8d154a-2e6a-470d-ab4f-45493e621d4d","Type":"ContainerDied","Data":"4934df943f44f12567d3849b63904a967b6a4390adaca1c807db3d3b3d0b1eb3"} Nov 03 17:50:45.864561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.864526 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" event={"ID":"8e8d154a-2e6a-470d-ab4f-45493e621d4d","Type":"ContainerDied","Data":"2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05"} Nov 03 17:50:45.864561 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.864536 4557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a658475b0177d127d4ba7a23ed20353b567dc666646cf022010798e24ca8c05" Nov 03 17:50:45.878284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:45.878227 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:50:46.019759 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019718 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.019933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019804 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.019933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019846 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.019933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019884 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.019933 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019919 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\" (UniqueName: \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.020132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.019988 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\") pod \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\" (UID: \"8e8d154a-2e6a-470d-ab4f-45493e621d4d\") " Nov 03 17:50:46.020132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020026 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:50:46.020132 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020104 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:50:46.020297 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020261 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:50:46.020399 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020383 4557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tmp-dir\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.020441 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020401 4557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-home\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.020441 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.020410 4557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-model-cache\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.022060 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.022039 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:50:46.022141 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.022047 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 17:50:46.022177 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.022141 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz" pod "8e8d154a-2e6a-470d-ab4f-45493e621d4d" (UID: "8e8d154a-2e6a-470d-ab4f-45493e621d4d"). InnerVolumeSpecName "kube-api-access-6h6kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:50:46.121768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.121728 4557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8d154a-2e6a-470d-ab4f-45493e621d4d-tls-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.121768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.121762 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h6kz\" (UniqueName: \"kubernetes.io/projected/8e8d154a-2e6a-470d-ab4f-45493e621d4d-kube-api-access-6h6kz\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.121768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.121778 4557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8d154a-2e6a-470d-ab4f-45493e621d4d-dshm\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:50:46.869637 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.869560 4557 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Nov 03 17:50:46.870043 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.869765 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q" Nov 03 17:50:46.890627 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.890596 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:50:46.895030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:46.894996 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-67776cc3-unmatched-kserve-8f8787df4-9bp4q"] Nov 03 17:50:48.338323 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:50:48.338274 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" path="/var/lib/kubelet/pods/8e8d154a-2e6a-470d-ab4f-45493e621d4d/volumes" Nov 03 17:50:49.415054 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:50:49.415014 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:51:14.896418 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:14.896338 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:51:14.897027 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:14.896999 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" containerID="cri-o://393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248" gracePeriod=30 Nov 03 17:51:19.415620 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:51:19.415579 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:51:19.956760 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:51:19.956723 4557 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2562ad01_b4d5_4ace_819e_8ef27a379f74.slice/crio-conmon-393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248.scope\": RecentStats: unable to find data in memory cache]" Nov 03 17:51:20.061596 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.061541 4557 generic.go:356] "Generic (PLEG): container finished" podID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerID="393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248" exitCode=0 Nov 03 17:51:20.061753 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.061604 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerDied","Data":"393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248"} Nov 03 17:51:20.061753 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.061666 4557 scope.go:122] "RemoveContainer" containerID="cc4cea1ab528fee0cfabf8122f8f1da0cc12501eeef72a96ed659eeb4a93b1ed" Nov 03 17:51:20.156238 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.156213 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:51:20.258895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.258842 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.258895 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.258905 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.258927 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.258953 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.258975 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259030 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259066 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259123 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259159 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259151 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\") pod \"2562ad01-b4d5-4ace-819e-8ef27a379f74\" (UID: \"2562ad01-b4d5-4ace-819e-8ef27a379f74\") " Nov 03 17:51:20.259509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259254 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:20.259509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259409 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:20.259509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259423 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:20.259509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259457 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:51:20.259734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259558 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.259734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259609 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2562ad01-b4d5-4ace-819e-8ef27a379f74-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.259734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259659 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.259734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259666 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:20.259734 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.259675 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.261404 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.261382 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:51:20.261509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.261477 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:51:20.261615 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.261594 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:20.261676 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.261598 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z" pod "2562ad01-b4d5-4ace-819e-8ef27a379f74" (UID: "2562ad01-b4d5-4ace-819e-8ef27a379f74"). InnerVolumeSpecName "kube-api-access-qx74z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:51:20.360994 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.360959 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.360994 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.360984 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx74z\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-kube-api-access-qx74z\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.360994 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.361001 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.361243 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.361010 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:20.361243 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:20.361018 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2562ad01-b4d5-4ace-819e-8ef27a379f74-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:21.068509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:21.068480 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" Nov 03 17:51:21.068509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:21.068488 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp" event={"ID":"2562ad01-b4d5-4ace-819e-8ef27a379f74","Type":"ContainerDied","Data":"3080b12f0996ce8eecb906163374b3896aa2950240c013f2bbb0da4e8b476b39"} Nov 03 17:51:21.069039 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:21.068538 4557 scope.go:122] "RemoveContainer" containerID="393bf6af0f35e5ce7c1c50d168cbf60587ae4a9fbecad60b1efca7c543685248" Nov 03 17:51:21.092222 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:21.092191 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:51:21.101119 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:21.101090 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e930f1-openshift-default-777d95d795-65fqp"] Nov 03 17:51:22.323778 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:22.323747 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" path="/var/lib/kubelet/pods/2562ad01-b4d5-4ace-819e-8ef27a379f74/volumes" Nov 03 17:51:28.797723 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:28.797684 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:51:28.798126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:28.798019 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" containerID="cri-o://c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca" gracePeriod=30 Nov 03 17:51:28.855763 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:28.855732 4557 scope.go:122] "RemoveContainer" containerID="365f710a02be6ea30ad38a86088159532964317ac552eab4550e7c1048b5585d" Nov 03 17:51:28.864662 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:28.864641 4557 scope.go:122] "RemoveContainer" containerID="dac08f123705d3efabe4c81cb9cc71885db4411c484600bcdc610026a1d3fb7f" Nov 03 17:51:28.872712 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:28.872683 4557 scope.go:122] "RemoveContainer" containerID="abf372c6d2eb59664d6ba88fb6024280ebe807e9b72a6a397d2d62cf29f612e3" Nov 03 17:51:29.795126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:29.795091 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:51:34.053368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.053336 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:51:34.143312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.143228 4557 generic.go:356] "Generic (PLEG): container finished" podID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerID="c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca" exitCode=0 Nov 03 17:51:34.143312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.143270 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" Nov 03 17:51:34.143312 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.143295 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerDied","Data":"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca"} Nov 03 17:51:34.143526 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.143340 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr" event={"ID":"8b70a79a-a132-4ce3-ab4e-25d354fd2b65","Type":"ContainerDied","Data":"e48832d1667341caca2feb91ba6c44600a06733267d72fe4944b1c9880eb32c8"} Nov 03 17:51:34.143526 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.143363 4557 scope.go:122] "RemoveContainer" containerID="c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca" Nov 03 17:51:34.152281 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.152263 4557 scope.go:122] "RemoveContainer" containerID="8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2" Nov 03 17:51:34.160415 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.160395 4557 scope.go:122] "RemoveContainer" containerID="c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca" Nov 03 17:51:34.160672 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:51:34.160653 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca\": container with ID starting with c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca not found: ID does not exist" containerID="c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca" Nov 03 17:51:34.160736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.160684 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca"} err="failed to get container status \"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca\": rpc error: code = NotFound desc = could not find container \"c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca\": container with ID starting with c4fa92b0e165bef03a9cbac9457e1bfadb1f562626a5270f56101d272d4b81ca not found: ID does not exist" Nov 03 17:51:34.160736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.160701 4557 scope.go:122] "RemoveContainer" containerID="8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2" Nov 03 17:51:34.160956 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:51:34.160941 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2\": container with ID starting with 8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2 not found: ID does not exist" containerID="8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2" Nov 03 17:51:34.160998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.160960 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2"} err="failed to get container status \"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2\": rpc error: code = NotFound desc = could not find container \"8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2\": container with ID starting with 8b49b91147e3fdbe4ab67299b597988756fd420858d1498d7c42e3838f1c51a2 not found: ID does not exist" Nov 03 17:51:34.193903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.193873 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.193951 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194016 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.193998 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194016 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194049 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194098 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194139 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194178 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194204 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194204 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\") pod \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\" (UID: \"8b70a79a-a132-4ce3-ab4e-25d354fd2b65\") " Nov 03 17:51:34.194509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194298 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:51:34.194509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194346 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:34.194509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194347 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:34.194509 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194488 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:34.194739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194614 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.194739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194630 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.194739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194643 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.194739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194653 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.194739 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.194625 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:34.196274 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.196249 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:51:34.196376 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.196319 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "kube-api-access-xw5dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:51:34.196439 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.196395 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:51:34.196768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.196751 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token" pod "8b70a79a-a132-4ce3-ab4e-25d354fd2b65" (UID: "8b70a79a-a132-4ce3-ab4e-25d354fd2b65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:51:34.295468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.295416 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw5dc\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-kube-api-access-xw5dc\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.295468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.295463 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.295468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.295473 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.295468 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.295483 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.295768 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.295492 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b70a79a-a132-4ce3-ab4e-25d354fd2b65-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:51:34.462673 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.462641 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:51:34.469838 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:34.469813 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-main-ed6b15-openshift-default-86c57fff55-8bmnr"] Nov 03 17:51:36.323068 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:51:36.323034 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" path="/var/lib/kubelet/pods/8b70a79a-a132-4ce3-ab4e-25d354fd2b65/volumes" Nov 03 17:51:49.414649 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:51:49.414614 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:52:04.957346 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:04.957308 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0140d12c-26txx_d22db20d-d6e6-4bfd-b8d2-fffec2757f50/revoke-keys/0.log" Nov 03 17:52:05.157778 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:05.157743 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-04f3ada8-vjwg4_8050acb4-12f7-4226-8689-3a46c4cc3ad0/revoke-keys/0.log" Nov 03 17:52:05.346658 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:05.346580 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-246d6b80-knpwb_0e7dda2b-5069-4243-8ce3-cd5b25d779ec/revoke-keys/0.log" Nov 03 17:52:05.519830 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:05.519795 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-2b56a21f-5nzrb_fc29dec6-f288-422d-82bd-d13b9be0a424/revoke-keys/0.log" Nov 03 17:52:05.711116 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:05.711091 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-58d7dc92-72brs_d4086381-23dc-4b59-a341-4e8ca07ae82a/revoke-keys/0.log" Nov 03 17:52:05.893317 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:05.893288 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-8d765196-5tp7l_521f5b46-461a-4e5b-b8f7-68891d08c642/revoke-keys/0.log" Nov 03 17:52:06.080111 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:06.080038 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a1dc6fd9-5wzkg_77b6d628-3425-4976-8d6e-8311462147aa/revoke-keys/0.log" Nov 03 17:52:06.271292 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:06.271264 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-b5efd0b9-kh26n_a04995b5-bb64-4892-8f1f-fff7c12250fe/revoke-keys/0.log" Nov 03 17:52:06.456021 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:06.455989 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-bae3e5f0-w67kv_3985ec73-7b35-4247-aace-b50a5e7c8e11/revoke-keys/0.log" Nov 03 17:52:06.648891 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:06.648856 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d624daf5-rmx7d_18e5819c-0ec5-456e-8ba5-bec5fb783859/revoke-keys/0.log" Nov 03 17:52:16.838745 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:16.838709 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f55b50db-dzxnt_c8f9e0b7-3010-4355-af5a-c71d293c5d5e/revoke-keys/0.log" Nov 03 17:52:19.415291 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:52:19.415253 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:52:28.525704 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:28.525669 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:52:28.765652 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:28.765627 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:52:29.176479 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:29.176454 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:52:31.396422 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:31.396374 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d87c9759-b8z5w_c7f1a5e3-8601-4f97-a279-925e88d47347/kube-auth-proxy/0.log" Nov 03 17:52:31.787594 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:31.787554 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-58ghk_597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0/istio-proxy/0.log" Nov 03 17:52:32.800340 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:32.800302 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-j5vsb_37479f66-ad1c-4520-bbd2-551ad87df1a1/istio-proxy/0.log" Nov 03 17:52:33.196932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:33.196903 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-pdhst_1d032dd2-9c34-409a-b5fc-37adbd874d69/istio-proxy/0.log" Nov 03 17:52:33.561092 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:33.561011 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-wh8tk_20a67715-6f72-4333-81ca-266f20a420c8/istio-proxy/0.log" Nov 03 17:52:33.947291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:33.947264 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-qdds7_88d8de8b-057e-49e9-84bb-ec619d90d768/payload-pre-processing/0.log" Nov 03 17:52:34.117949 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:34.117898 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-qq4w2_374f1edb-d1ac-45c8-8cbb-ef8e776f8120/payload-processing/0.log" Nov 03 17:52:35.704763 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:35.704727 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:52:36.087981 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:36.087907 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:52:36.684508 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:36.684476 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:52:36.867353 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:36.867318 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:52:40.023941 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:40.023832 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt"] Nov 03 17:52:40.026713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:40.026687 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f55b50db-dzxnt"] Nov 03 17:52:40.323189 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:40.323104 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8f9e0b7-3010-4355-af5a-c71d293c5d5e" path="/var/lib/kubelet/pods/c8f9e0b7-3010-4355-af5a-c71d293c5d5e/volumes" Nov 03 17:52:47.791481 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791440 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9t59p/must-gather-2ccrq"] Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791921 4557 cpu_manager.go:414] "containerMap: removing container" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791935 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791953 4557 cpu_manager.go:414] "containerMap: removing container" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791959 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791970 4557 cpu_manager.go:414] "containerMap: removing container" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791975 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791989 4557 cpu_manager.go:414] "containerMap: removing container" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerName="main" Nov 03 17:52:47.791993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.791993 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerName="main" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792004 4557 cpu_manager.go:414] "containerMap: removing container" podUID="fc29dec6-f288-422d-82bd-d13b9be0a424" containerName="revoke-keys" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792009 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc29dec6-f288-422d-82bd-d13b9be0a424" containerName="revoke-keys" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792086 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792094 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc29dec6-f288-422d-82bd-d13b9be0a424" containerName="revoke-keys" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792101 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792107 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792113 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="2562ad01-b4d5-4ace-819e-8ef27a379f74" containerName="istio-proxy" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792119 4557 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e8d154a-2e6a-470d-ab4f-45493e621d4d" containerName="main" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792191 4557 cpu_manager.go:414] "containerMap: removing container" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.792255 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.792196 4557 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b70a79a-a132-4ce3-ab4e-25d354fd2b65" containerName="istio-proxy" Nov 03 17:52:47.794996 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.794964 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:47.806259 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.806225 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9t59p/must-gather-2ccrq"] Nov 03 17:52:47.900391 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.900350 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9t59p\"/\"kube-root-ca.crt\"" Nov 03 17:52:47.900391 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.900395 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9t59p\"/\"default-dockercfg-94mwt\"" Nov 03 17:52:47.900636 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.900431 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9t59p\"/\"openshift-service-ca.crt\"" Nov 03 17:52:47.905870 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.905846 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-must-gather-output\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:47.905993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:47.905906 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqcl\" (UniqueName: \"kubernetes.io/projected/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-kube-api-access-xxqcl\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.006952 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.006916 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqcl\" (UniqueName: \"kubernetes.io/projected/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-kube-api-access-xxqcl\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.007117 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.007003 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-must-gather-output\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.007308 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.007292 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-must-gather-output\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.019187 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.019166 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqcl\" (UniqueName: \"kubernetes.io/projected/8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782-kube-api-access-xxqcl\") pod \"must-gather-2ccrq\" (UID: \"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782\") " pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.110803 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.110722 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9t59p/must-gather-2ccrq" Nov 03 17:52:48.389378 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.389351 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9t59p/must-gather-2ccrq"] Nov 03 17:52:48.390670 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:52:48.390642 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cfadf0c_ad9d_4f2e_b3b5_b885c9ef8782.slice/crio-d065c984120e738d3f87438821439cb3bd4bbd16b4b4c9209e8c38ea2e245a66 WatchSource:0}: Error finding container d065c984120e738d3f87438821439cb3bd4bbd16b4b4c9209e8c38ea2e245a66: Status 404 returned error can't find the container with id d065c984120e738d3f87438821439cb3bd4bbd16b4b4c9209e8c38ea2e245a66 Nov 03 17:52:48.395923 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.395897 4557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 17:52:48.534432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:48.534397 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9t59p/must-gather-2ccrq" event={"ID":"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782","Type":"ContainerStarted","Data":"d065c984120e738d3f87438821439cb3bd4bbd16b4b4c9209e8c38ea2e245a66"} Nov 03 17:52:49.415347 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:52:49.415310 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:52:50.890959 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:50.890929 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j72rg_db4a2814-a7a4-4181-9e07-d433c6ea5e1b/global-pull-secret-syncer/0.log" Nov 03 17:52:51.140742 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:51.140712 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rzndd_05c258f2-553a-4da7-875a-4eb12d044178/konnectivity-agent/0.log" Nov 03 17:52:51.220347 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:51.220305 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-130.us-east-2.compute.internal_dfd3375087b535eb1ba3fbe0bafa7b69/haproxy/0.log" Nov 03 17:52:54.025271 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:54.025228 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg"] Nov 03 17:52:54.027641 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:54.027618 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a1dc6fd9-5wzkg"] Nov 03 17:52:54.324010 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:52:54.323911 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77b6d628-3425-4976-8d6e-8311462147aa" path="/var/lib/kubelet/pods/77b6d628-3425-4976-8d6e-8311462147aa/volumes" Nov 03 17:53:03.620288 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:03.620251 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9t59p/must-gather-2ccrq" event={"ID":"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782","Type":"ContainerStarted","Data":"aa960e2256bd20053ac6395048b2a4328ec5e2ed59bf222ebde6b53f59b06415"} Nov 03 17:53:03.620736 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:03.620298 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9t59p/must-gather-2ccrq" event={"ID":"8cfadf0c-ad9d-4f2e-b3b5-b885c9ef8782","Type":"ContainerStarted","Data":"76fb14235b097c5781c49eb0c24621b09253ff6bfd1961886d671a86238eb048"} Nov 03 17:53:03.639405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:03.639346 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-9t59p/must-gather-2ccrq" podStartSLOduration=2.195501301 podStartE2EDuration="16.639332786s" totalImagesPullingTime="14.443831485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:53:03.637958181 +0000 UTC m=+1415.475071002" watchObservedRunningTime="2026-11-03 17:53:03.639332786 +0000 UTC m=+1415.476445614" Nov 03 17:53:04.024443 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:04.024409 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l"] Nov 03 17:53:04.027329 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:04.027304 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8d765196-5tp7l"] Nov 03 17:53:04.324046 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:04.323927 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="521f5b46-461a-4e5b-b8f7-68891d08c642" path="/var/lib/kubelet/pods/521f5b46-461a-4e5b-b8f7-68891d08c642/volumes" Nov 03 17:53:07.952377 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:07.952347 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d87c9759-b8z5w_c7f1a5e3-8601-4f97-a279-925e88d47347/kube-auth-proxy/0.log" Nov 03 17:53:07.990249 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:07.990216 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-58ghk_597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0/istio-proxy/0.log" Nov 03 17:53:08.081144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:08.081104 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-j5vsb_37479f66-ad1c-4520-bbd2-551ad87df1a1/istio-proxy/0.log" Nov 03 17:53:08.115660 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:08.115635 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-pdhst_1d032dd2-9c34-409a-b5fc-37adbd874d69/istio-proxy/0.log" Nov 03 17:53:08.153353 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:08.153328 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-wh8tk_20a67715-6f72-4333-81ca-266f20a420c8/istio-proxy/0.log" Nov 03 17:53:08.186873 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:08.186839 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-qdds7_88d8de8b-057e-49e9-84bb-ec619d90d768/payload-pre-processing/0.log" Nov 03 17:53:08.203098 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:08.203030 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-qq4w2_374f1edb-d1ac-45c8-8cbb-ef8e776f8120/payload-processing/0.log" Nov 03 17:53:09.426816 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:09.426777 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:53:09.446033 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:09.446002 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:53:09.474998 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:09.474968 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:53:14.024324 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:14.024276 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n"] Nov 03 17:53:14.026848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:14.026824 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b5efd0b9-kh26n"] Nov 03 17:53:14.322885 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:14.322812 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a04995b5-bb64-4892-8f1f-fff7c12250fe" path="/var/lib/kubelet/pods/a04995b5-bb64-4892-8f1f-fff7c12250fe/volumes" Nov 03 17:53:19.415210 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:53:19.415163 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:53:24.018996 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.018963 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-5c57bbd4fc-fxnnt_58ad7fd3-36a8-4f7b-a69f-dedabb08632f/cert-manager-cainjector/0.log" Nov 03 17:53:24.025216 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.025185 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx"] Nov 03 17:53:24.028711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.028687 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0140d12c-26txx"] Nov 03 17:53:24.036184 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.036164 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-5dbbbf75cc-55lxc_62c0fb3a-50e9-4791-9255-9202dfd049c6/cert-manager-webhook/0.log" Nov 03 17:53:24.334089 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.334005 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d22db20d-d6e6-4bfd-b8d2-fffec2757f50" path="/var/lib/kubelet/pods/d22db20d-d6e6-4bfd-b8d2-fffec2757f50/volumes" Nov 03 17:53:24.551114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.551076 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f494f769f-hxpbv_bba908a5-4ba6-40e8-bf5d-d735c8b8eace/manager/0.log" Nov 03 17:53:24.566035 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:24.566008 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f494f769f-hxpbv_bba908a5-4ba6-40e8-bf5d-d735c8b8eace/copy-manifests/0.log" Nov 03 17:53:26.449331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.449299 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d87c9759-b8z5w_c7f1a5e3-8601-4f97-a279-925e88d47347/kube-auth-proxy/0.log" Nov 03 17:53:26.491185 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.491155 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-58ghk_597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0/istio-proxy/0.log" Nov 03 17:53:26.586884 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.586853 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-j5vsb_37479f66-ad1c-4520-bbd2-551ad87df1a1/istio-proxy/0.log" Nov 03 17:53:26.625331 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.625304 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-pdhst_1d032dd2-9c34-409a-b5fc-37adbd874d69/istio-proxy/0.log" Nov 03 17:53:26.663294 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.663264 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-wh8tk_20a67715-6f72-4333-81ca-266f20a420c8/istio-proxy/0.log" Nov 03 17:53:26.698465 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.698431 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-qdds7_88d8de8b-057e-49e9-84bb-ec619d90d768/payload-pre-processing/0.log" Nov 03 17:53:26.725126 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:26.725058 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-qq4w2_374f1edb-d1ac-45c8-8cbb-ef8e776f8120/payload-processing/0.log" Nov 03 17:53:27.443356 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:27.443330 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-65fbc5dc-2xxbm_0eb80c9e-3915-4f4f-92c7-e94d70d0c65f/manager/0.log" Nov 03 17:53:27.460844 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:27.460817 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-rhphw_c532d758-aeaf-4711-9cf9-80e4b9eb5dfd/jobset-operator/0.log" Nov 03 17:53:28.375289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.375257 4557 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs"] Nov 03 17:53:28.381746 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.381720 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.390769 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.390737 4557 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cw7mv\"/\"default-dockercfg-blgxz\"" Nov 03 17:53:28.391208 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.391169 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cw7mv\"/\"openshift-service-ca.crt\"" Nov 03 17:53:28.391754 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.391722 4557 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cw7mv\"/\"kube-root-ca.crt\"" Nov 03 17:53:28.392711 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.392685 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs"] Nov 03 17:53:28.518293 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.518261 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-podres\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.518702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.518314 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-proc\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.518702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.518395 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2wrl\" (UniqueName: \"kubernetes.io/projected/5a051013-137b-4143-8c4a-f5c0167bf4b3-kube-api-access-q2wrl\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.518702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.518456 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-lib-modules\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.518702 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.518518 4557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-sys\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619230 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619194 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-podres\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619248 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-proc\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619319 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-proc\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619345 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-podres\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619396 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2wrl\" (UniqueName: \"kubernetes.io/projected/5a051013-137b-4143-8c4a-f5c0167bf4b3-kube-api-access-q2wrl\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619432 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619427 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-lib-modules\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619718 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619483 4557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-sys\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619718 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619612 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-lib-modules\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.619718 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.619627 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a051013-137b-4143-8c4a-f5c0167bf4b3-sys\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.632455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.632392 4557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2wrl\" (UniqueName: \"kubernetes.io/projected/5a051013-137b-4143-8c4a-f5c0167bf4b3-kube-api-access-q2wrl\") pod \"perf-node-gather-daemonset-cl2cs\" (UID: \"5a051013-137b-4143-8c4a-f5c0167bf4b3\") " pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.699787 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.699748 4557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:28.983167 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:28.983136 4557 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs"] Nov 03 17:53:28.986351 ip-10-0-141-130 kubenswrapper[4557]: W1103 17:53:28.986323 4557 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a051013_137b_4143_8c4a_f5c0167bf4b3.slice/crio-2ace1f1740a53d51fa429ffebf498c0bc2958ea26ea5f4cb847b32810c26510a WatchSource:0}: Error finding container 2ace1f1740a53d51fa429ffebf498c0bc2958ea26ea5f4cb847b32810c26510a: Status 404 returned error can't find the container with id 2ace1f1740a53d51fa429ffebf498c0bc2958ea26ea5f4cb847b32810c26510a Nov 03 17:53:29.779610 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:29.779549 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" event={"ID":"5a051013-137b-4143-8c4a-f5c0167bf4b3","Type":"ContainerStarted","Data":"42d72e413c836910173597496f22f38e21ccce2c2fab2d7faf78dac8566c3451"} Nov 03 17:53:29.780017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:29.779634 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" event={"ID":"5a051013-137b-4143-8c4a-f5c0167bf4b3","Type":"ContainerStarted","Data":"2ace1f1740a53d51fa429ffebf498c0bc2958ea26ea5f4cb847b32810c26510a"} Nov 03 17:53:29.780017 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:29.779745 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:29.799135 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:29.799090 4557 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" podStartSLOduration=1.799075212 podStartE2EDuration="1.799075212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:53:29.797911297 +0000 UTC m=+1441.635024123" watchObservedRunningTime="2026-11-03 17:53:29.799075212 +0000 UTC m=+1441.636188035" Nov 03 17:53:35.025660 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:35.025624 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv"] Nov 03 17:53:35.031001 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:35.030972 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bae3e5f0-w67kv"] Nov 03 17:53:35.795713 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:35.795682 4557 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cw7mv/perf-node-gather-daemonset-cl2cs" Nov 03 17:53:36.322029 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:36.322000 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3985ec73-7b35-4247-aace-b50a5e7c8e11" path="/var/lib/kubelet/pods/3985ec73-7b35-4247-aace-b50a5e7c8e11/volumes" Nov 03 17:53:49.418816 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:53:49.418771 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:53:54.674554 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:54.674516 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:53:54.705525 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:54.705495 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:53:54.748815 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:53:54.748786 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:54:05.059655 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:05.059616 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:54:05.099978 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:05.099941 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:54:05.135769 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:05.135739 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:54:15.241885 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.241814 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d87c9759-b8z5w_c7f1a5e3-8601-4f97-a279-925e88d47347/kube-auth-proxy/0.log" Nov 03 17:54:15.289040 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.289003 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-58ghk_597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0/istio-proxy/0.log" Nov 03 17:54:15.504036 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.503940 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-j5vsb_37479f66-ad1c-4520-bbd2-551ad87df1a1/istio-proxy/0.log" Nov 03 17:54:15.583425 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.583394 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-pdhst_1d032dd2-9c34-409a-b5fc-37adbd874d69/istio-proxy/0.log" Nov 03 17:54:15.639626 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.639561 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-wh8tk_20a67715-6f72-4333-81ca-266f20a420c8/istio-proxy/0.log" Nov 03 17:54:15.697876 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.697842 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-qdds7_88d8de8b-057e-49e9-84bb-ec619d90d768/payload-pre-processing/0.log" Nov 03 17:54:15.734374 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.734337 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-qq4w2_374f1edb-d1ac-45c8-8cbb-ef8e776f8120/payload-processing/0.log" Nov 03 17:54:15.952456 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.952419 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:54:15.985693 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:15.985660 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:54:16.032280 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:16.032253 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:54:19.417493 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:54:19.417449 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:54:26.586175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:26.586138 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:54:26.619418 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:26.619379 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:54:26.671994 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:26.671970 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:54:28.514136 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.514106 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:54:28.514902 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.514869 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-slpkv_fbbcb6a4-1f46-4982-b614-2e838dcf6589/ovn-acl-logging/0.log" Nov 03 17:54:28.954350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.954315 4557 scope.go:122] "RemoveContainer" containerID="5113de4ffd9a55b19128b2120dabe82888a3bab124ea6dc6d39e407dfbe551cb" Nov 03 17:54:28.968875 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.968833 4557 scope.go:122] "RemoveContainer" containerID="0cd35803f79ef9e1a70cf9676b75c99b6cb385e2d64b6c8b36c2e23873e0023a" Nov 03 17:54:28.978205 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.978176 4557 scope.go:122] "RemoveContainer" containerID="aedc683aa4f43c9984207caf7cdf49241d7d1b698bc20a93a487713d9ccc4eff" Nov 03 17:54:28.990498 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:28.990184 4557 scope.go:122] "RemoveContainer" containerID="6afe45a531c75b0925df6e175fbe2f15ea2f7cfce6185c59eb0bd395e78274fa" Nov 03 17:54:29.000684 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:29.000658 4557 scope.go:122] "RemoveContainer" containerID="923d7b0d8cb2294ee03b6912b6f7e2ffa047d8f94734a86c116aca18abfae98e" Nov 03 17:54:33.628107 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:33.628059 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:54:33.665562 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:33.665530 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:54:33.728997 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:33.728969 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:54:33.750923 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:33.750895 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:54:38.026393 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:38.026345 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4"] Nov 03 17:54:38.030153 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:38.030123 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-04f3ada8-vjwg4"] Nov 03 17:54:38.323291 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:38.323209 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8050acb4-12f7-4226-8689-3a46c4cc3ad0" path="/var/lib/kubelet/pods/8050acb4-12f7-4226-8689-3a46c4cc3ad0/volumes" Nov 03 17:54:48.025209 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:48.025162 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs"] Nov 03 17:54:48.031440 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:48.031410 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-58d7dc92-72brs"] Nov 03 17:54:48.323579 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:48.323495 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4086381-23dc-4b59-a341-4e8ca07ae82a" path="/var/lib/kubelet/pods/d4086381-23dc-4b59-a341-4e8ca07ae82a/volumes" Nov 03 17:54:49.416064 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:54:49.416025 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:54:58.025992 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.025931 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d"] Nov 03 17:54:58.029096 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.029057 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d624daf5-rmx7d"] Nov 03 17:54:58.204945 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.204905 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:54:58.235066 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.235037 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:54:58.268622 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.268596 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:54:58.327335 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:54:58.327266 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18e5819c-0ec5-456e-8ba5-bec5fb783859" path="/var/lib/kubelet/pods/18e5819c-0ec5-456e-8ba5-bec5fb783859/volumes" Nov 03 17:55:08.023139 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:08.023104 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb"] Nov 03 17:55:08.025742 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:08.025715 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-246d6b80-knpwb"] Nov 03 17:55:08.323144 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:08.323066 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e7dda2b-5069-4243-8ce3-cd5b25d779ec" path="/var/lib/kubelet/pods/0e7dda2b-5069-4243-8ce3-cd5b25d779ec/volumes" Nov 03 17:55:18.037884 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:18.037846 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb"] Nov 03 17:55:18.041081 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:18.041047 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b56a21f-5nzrb"] Nov 03 17:55:18.331478 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:18.331396 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc29dec6-f288-422d-82bd-d13b9be0a424" path="/var/lib/kubelet/pods/fc29dec6-f288-422d-82bd-d13b9be0a424/volumes" Nov 03 17:55:19.419522 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:19.419483 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:55:19.675112 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:19.675030 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:55:19.769073 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:19.769044 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:55:19.860728 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:19.860697 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:55:28.877944 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:28.877865 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:55:28.918764 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:28.918725 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:55:28.979896 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:28.979868 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:55:29.002036 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:29.002001 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:55:29.049806 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:29.049773 4557 scope.go:122] "RemoveContainer" containerID="4934df943f44f12567d3849b63904a967b6a4390adaca1c807db3d3b3d0b1eb3" Nov 03 17:55:29.065752 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:29.062810 4557 scope.go:122] "RemoveContainer" containerID="8ee4e54ba00d082a1e7ec5478af2793634785985fc3525d69f75aa90e6cd1c02" Nov 03 17:55:32.233157 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:32.233104 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:55:32.263858 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:32.263828 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:55:32.294647 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:32.294621 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:55:49.415488 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:49.415445 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:55:54.149930 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.149873 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:55:54.150618 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.150226 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerName="istio-proxy" containerID="cri-o://cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf" gracePeriod=30 Nov 03 17:55:54.152580 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.152543 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:55:54.152817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.152795 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerName="istio-proxy" containerID="cri-o://fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc" gracePeriod=30 Nov 03 17:55:54.154405 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.154378 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:55:54.154649 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.154625 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" podUID="20a67715-6f72-4333-81ca-266f20a420c8" containerName="istio-proxy" containerID="cri-o://f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f" gracePeriod=30 Nov 03 17:55:54.156669 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.156637 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:55:54.156919 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:54.156893 4557 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerName="istio-proxy" containerID="cri-o://8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564" gracePeriod=30 Nov 03 17:55:56.884390 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:56.884355 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:55:56.917493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:56.917464 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:55:56.968289 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:56.968261 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:55:56.984263 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:56.984237 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:55:59.444175 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.444104 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:55:59.515709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.515682 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:55:59.527169 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.527151 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:55:59.531303 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531279 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531437 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531314 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531437 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531346 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531525 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531722 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531695 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531839 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531722 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:55:59.531839 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531757 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531839 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531794 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531839 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531826 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.531993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531856 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.531993 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531877 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\") pod \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\" (UID: \"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0\") " Nov 03 17:55:59.532118 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.531998 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.532248 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532221 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:55:59.532248 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532231 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.532368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532286 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.532368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532324 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.532368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532340 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.532368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532353 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.532368 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.532367 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.533688 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.533662 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.533892 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.533873 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:55:59.534061 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.534045 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "kube-api-access-pks57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.534758 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.534745 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token" pod "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" (UID: "597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.632816 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632780 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.632816 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632819 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632844 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632872 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632908 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632940 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.632969 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633038 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633015 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.633360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633071 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.633360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633096 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.633360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633123 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.633360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633139 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633360 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633128 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.633654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633374 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.633654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633486 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:55:59.633654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633502 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:55:59.633654 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633623 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633635 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633676 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633720 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633754 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633792 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.633865 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633825 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633875 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633936 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633945 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633963 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.633991 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634043 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634087 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634160 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634132 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.634544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634167 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634203 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634247 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\") pod \"20a67715-6f72-4333-81ca-266f20a420c8\" (UID: \"20a67715-6f72-4333-81ca-266f20a420c8\") " Nov 03 17:55:59.634544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634282 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\") pod \"1d032dd2-9c34-409a-b5fc-37adbd874d69\" (UID: \"1d032dd2-9c34-409a-b5fc-37adbd874d69\") " Nov 03 17:55:59.634544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634310 4557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\") pod \"37479f66-ad1c-4520-bbd2-551ad87df1a1\" (UID: \"37479f66-ad1c-4520-bbd2-551ad87df1a1\") " Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634674 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634693 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634707 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20a67715-6f72-4333-81ca-266f20a420c8-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634720 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d032dd2-9c34-409a-b5fc-37adbd874d69-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634736 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634750 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634764 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pks57\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-kube-api-access-pks57\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634779 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634795 4557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-certs\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.634817 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634809 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.635426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634826 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.635426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634841 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.635426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634856 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.635426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.634869 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.635426 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635285 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 17:55:59.635709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635515 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.635709 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635630 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.635820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635736 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.635820 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635740 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.636019 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.635969 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.636147 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636124 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:55:59.636212 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636165 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.636339 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636312 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "kube-api-access-hl7jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.636411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636363 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.636560 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636539 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 17:55:59.636903 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.636845 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "kube-api-access-8g7jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.637721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.637690 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:55:59.637848 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.637832 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.637962 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.637948 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.638032 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.638013 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo" pod "37479f66-ad1c-4520-bbd2-551ad87df1a1" (UID: "37479f66-ad1c-4520-bbd2-551ad87df1a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 17:55:59.638316 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.638299 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np" pod "20a67715-6f72-4333-81ca-266f20a420c8" (UID: "20a67715-6f72-4333-81ca-266f20a420c8"). InnerVolumeSpecName "kube-api-access-b76np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.638439 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.638425 4557 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token" pod "1d032dd2-9c34-409a-b5fc-37adbd874d69" (UID: "1d032dd2-9c34-409a-b5fc-37adbd874d69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735455 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b76np\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-kube-api-access-b76np\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735484 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735494 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735503 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20a67715-6f72-4333-81ca-266f20a420c8-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735512 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735520 4557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37479f66-ad1c-4520-bbd2-551ad87df1a1-istiod-ca-cert\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735529 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735537 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735537 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735546 4557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-istio-envoy\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735555 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20a67715-6f72-4333-81ca-266f20a420c8-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735562 4557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-podinfo\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735593 4557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-istio-data\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735602 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl7jh\" (UniqueName: \"kubernetes.io/projected/37479f66-ad1c-4520-bbd2-551ad87df1a1-kube-api-access-hl7jh\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735610 4557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g7jd\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-kube-api-access-8g7jd\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735618 4557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-credential-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735627 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20a67715-6f72-4333-81ca-266f20a420c8-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735636 4557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d032dd2-9c34-409a-b5fc-37adbd874d69-istio-token\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.735931 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.735644 4557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37479f66-ad1c-4520-bbd2-551ad87df1a1-workload-socket\") on node \"ip-10-0-141-130.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 17:55:59.769187 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.769153 4557 generic.go:356] "Generic (PLEG): container finished" podID="1d032dd2-9c34-409a-b5fc-37adbd874d69" containerID="fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc" exitCode=0 Nov 03 17:55:59.769332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.769208 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" Nov 03 17:55:59.769332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.769243 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" event={"ID":"1d032dd2-9c34-409a-b5fc-37adbd874d69","Type":"ContainerDied","Data":"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc"} Nov 03 17:55:59.769332 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.769301 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst" event={"ID":"1d032dd2-9c34-409a-b5fc-37adbd874d69","Type":"ContainerDied","Data":"ad59d383269609d658df93dd0c5d01b054aa167cdd011e81e5aa45173c1a292d"} Nov 03 17:55:59.769446 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.769333 4557 scope.go:122] "RemoveContainer" containerID="fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc" Nov 03 17:55:59.770628 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.770603 4557 generic.go:356] "Generic (PLEG): container finished" podID="20a67715-6f72-4333-81ca-266f20a420c8" containerID="f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f" exitCode=0 Nov 03 17:55:59.770731 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.770647 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" Nov 03 17:55:59.770731 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.770684 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" event={"ID":"20a67715-6f72-4333-81ca-266f20a420c8","Type":"ContainerDied","Data":"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f"} Nov 03 17:55:59.770845 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.770731 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk" event={"ID":"20a67715-6f72-4333-81ca-266f20a420c8","Type":"ContainerDied","Data":"132fe1201fd939e93da05e20f6f1f2a8f63fd7aa6f83f51f51b9a3c787be2000"} Nov 03 17:55:59.772106 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.772082 4557 generic.go:356] "Generic (PLEG): container finished" podID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" containerID="cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf" exitCode=0 Nov 03 17:55:59.772225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.772120 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" Nov 03 17:55:59.772225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.772168 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" event={"ID":"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0","Type":"ContainerDied","Data":"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf"} Nov 03 17:55:59.772225 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.772220 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk" event={"ID":"597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0","Type":"ContainerDied","Data":"802bbe707b1c7cf6a603db048ea750bfc71205939dc09d7e06597bfe730f9379"} Nov 03 17:55:59.773783 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.773755 4557 generic.go:356] "Generic (PLEG): container finished" podID="37479f66-ad1c-4520-bbd2-551ad87df1a1" containerID="8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564" exitCode=0 Nov 03 17:55:59.773880 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.773805 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" event={"ID":"37479f66-ad1c-4520-bbd2-551ad87df1a1","Type":"ContainerDied","Data":"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564"} Nov 03 17:55:59.773880 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.773843 4557 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" event={"ID":"37479f66-ad1c-4520-bbd2-551ad87df1a1","Type":"ContainerDied","Data":"a327c6bd46bc33253eacdfaecaf1708ba62dd6a193f4774ebafbfdf00682468d"} Nov 03 17:55:59.774054 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.773902 4557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb" Nov 03 17:55:59.781057 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.781036 4557 scope.go:122] "RemoveContainer" containerID="fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc" Nov 03 17:55:59.781372 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:59.781341 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc\": container with ID starting with fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc not found: ID does not exist" containerID="fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc" Nov 03 17:55:59.781455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.781381 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc"} err="failed to get container status \"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc\": rpc error: code = NotFound desc = could not find container \"fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc\": container with ID starting with fd4c68c6b106d5d43384246922b8a2ce50822632020e79a228acbd6dbd56cbdc not found: ID does not exist" Nov 03 17:55:59.781455 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.781403 4557 scope.go:122] "RemoveContainer" containerID="f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f" Nov 03 17:55:59.795396 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.795377 4557 scope.go:122] "RemoveContainer" containerID="f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f" Nov 03 17:55:59.795735 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:59.795711 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f\": container with ID starting with f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f not found: ID does not exist" containerID="f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f" Nov 03 17:55:59.795800 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.795742 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f"} err="failed to get container status \"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f\": rpc error: code = NotFound desc = could not find container \"f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f\": container with ID starting with f77ca51794cd36bcac78851ec00a220deee314cd0a5d7c27d055f42edd0e663f not found: ID does not exist" Nov 03 17:55:59.795800 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.795760 4557 scope.go:122] "RemoveContainer" containerID="cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf" Nov 03 17:55:59.805055 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.805034 4557 scope.go:122] "RemoveContainer" containerID="cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf" Nov 03 17:55:59.805321 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:59.805302 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf\": container with ID starting with cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf not found: ID does not exist" containerID="cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf" Nov 03 17:55:59.805365 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.805331 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf"} err="failed to get container status \"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf\": rpc error: code = NotFound desc = could not find container \"cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf\": container with ID starting with cbd27dc219b1bfae3f245f45d31c2d45a66c9055e4ff2da1c0e24f5ffb99c0cf not found: ID does not exist" Nov 03 17:55:59.805365 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.805346 4557 scope.go:122] "RemoveContainer" containerID="8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564" Nov 03 17:55:59.805770 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.805747 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:55:59.811484 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.811453 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-pdhst"] Nov 03 17:55:59.814147 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.814129 4557 scope.go:122] "RemoveContainer" containerID="8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564" Nov 03 17:55:59.814403 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:55:59.814380 4557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564\": container with ID starting with 8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564 not found: ID does not exist" containerID="8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564" Nov 03 17:55:59.814467 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.814414 4557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564"} err="failed to get container status \"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564\": rpc error: code = NotFound desc = could not find container \"8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564\": container with ID starting with 8ceb3f2e57d3c6d29e63fb6ba1085ce49b562da3797bea364e76200f8802d564 not found: ID does not exist" Nov 03 17:55:59.824586 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.824549 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:55:59.836278 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.836250 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-wh8tk"] Nov 03 17:55:59.848284 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.848256 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:55:59.852784 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.852762 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-58ghk"] Nov 03 17:55:59.866030 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.866006 4557 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:55:59.870505 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:55:59.870482 4557 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-j5vsb"] Nov 03 17:56:00.323350 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:00.323315 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d032dd2-9c34-409a-b5fc-37adbd874d69" path="/var/lib/kubelet/pods/1d032dd2-9c34-409a-b5fc-37adbd874d69/volumes" Nov 03 17:56:00.323932 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:00.323917 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20a67715-6f72-4333-81ca-266f20a420c8" path="/var/lib/kubelet/pods/20a67715-6f72-4333-81ca-266f20a420c8/volumes" Nov 03 17:56:00.324436 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:00.324423 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37479f66-ad1c-4520-bbd2-551ad87df1a1" path="/var/lib/kubelet/pods/37479f66-ad1c-4520-bbd2-551ad87df1a1/volumes" Nov 03 17:56:00.325378 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:00.325358 4557 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0" path="/var/lib/kubelet/pods/597a28f9-4ac9-46a7-a4c5-2e1fd2ce54c0/volumes" Nov 03 17:56:03.452411 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:03.452376 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:56:03.485869 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:03.485840 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:56:03.514726 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:03.514697 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:56:19.423748 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:56:19.423710 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:56:23.952251 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:23.952221 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:56:23.996396 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:23.996360 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:56:24.063399 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:24.063364 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:56:24.087277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:24.087251 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:56:29.109089 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:29.109057 4557 scope.go:122] "RemoveContainer" containerID="6942b26b75358831db842e1d8e7b89f29078b43c72d66e673ae3db6e3d241912" Nov 03 17:56:29.118478 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:29.118456 4557 scope.go:122] "RemoveContainer" containerID="13c22d576779101eae7ad8e4713eaf6b4213bc71156d920caf65121bc3db356f" Nov 03 17:56:29.126386 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:29.126366 4557 scope.go:122] "RemoveContainer" containerID="b326acddd7f8eac067829d814001a46a9479d9d6a403e5563407ce3f45509746" Nov 03 17:56:29.134370 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:29.134348 4557 scope.go:122] "RemoveContainer" containerID="5dd5de18ac6ab3b6f74d28688ef01c1c6f60d7f910873131792e5271e8753d58" Nov 03 17:56:29.143851 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:29.143826 4557 scope.go:122] "RemoveContainer" containerID="e5777675d4f941b93af8d0e3823dbc0ac3a2bc5f3a8ab58609d80a3fe1ea4305" Nov 03 17:56:41.153681 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:41.153652 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:56:41.187544 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:41.187512 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:56:41.245412 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:41.245386 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:56:41.262089 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:41.262064 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:56:44.399584 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:44.399363 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:56:44.434114 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:44.434081 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:56:44.472297 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:44.472264 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:56:48.999369 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:48.999335 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:56:49.041720 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:49.041661 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:56:49.096277 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:49.096248 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:56:49.116429 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:49.116400 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:56:49.420846 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:56:49.420779 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:56:57.027391 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:57.027353 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hqsx9_2f29a52b-7a08-4087-bce5-98ac64c3cff6/main/0.log" Nov 03 17:56:57.064858 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:57.064825 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfcc9_f35f854e-486f-4df4-bd48-047b4f6d0a07/main/0.log" Nov 03 17:56:57.118113 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:57.118081 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-f5zfx_e9d8b694-81fe-49b5-aaec-0308d3d6722d/main/0.log" Nov 03 17:56:57.135677 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:56:57.135644 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-p6kkw_5890de18-58f7-4769-849f-3bc1b1e99a78/main/0.log" Nov 03 17:57:06.886259 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:06.886217 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:57:06.929004 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:06.928962 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:57:06.968086 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:06.968056 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:57:19.419843 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:57:19.419752 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:57:28.546386 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:28.546350 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:57:28.575672 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:28.575627 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:57:28.609534 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:28.608194 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:57:39.803093 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:39.803049 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:57:39.831489 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:39.831458 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:57:39.862604 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:57:39.862579 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:57:49.415898 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:57:49.415859 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:58:00.592493 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:00.592454 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:58:00.621603 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:00.621553 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:58:00.650956 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:00.650929 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:58:11.179721 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:11.179665 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:58:11.212898 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:11.212855 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:58:11.244409 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:11.244381 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log" Nov 03 17:58:19.417432 ip-10-0-141-130 kubenswrapper[4557]: E1103 17:58:19.417388 4557 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-6jcf5" containerName="extractor" Nov 03 17:58:31.884922 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:31.884874 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d976d64f5-zh78d_ffad44c3-2b73-4842-8c6f-7c80948bbf1d/authorino/0.log" Nov 03 17:58:31.914037 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:31.913994 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-7cv8d_60b500e1-7297-43cc-b2c8-1a8a755c0f18/manager/0.log" Nov 03 17:58:31.946215 ip-10-0-141-130 kubenswrapper[4557]: I1103 17:58:31.946188 4557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-hf6pb_4befb32e-0a5e-4bca-835c-934649c9b9fb/kuadrant-console-plugin/0.log"